A system and method for multi-label image segmentation is provided. The method comprises the steps of: receiving image data including a set of labeled image elements; mapping a change in intensities of the image data to edge weights; determining potentials for each image element in the image data; and assigning a label, based upon the determined potentials, to each image element in the image data.