A system and method for segmenting cardiac images and, in particular, segmenting the left ventricle of the heart using a contour propagation model that integrates visual information and anatomical constraints. The visual information comprises a gradient vector flow-based boundary component and a region component that separates the cardiac contours/regions according to their global intensity properties that reflect the different tissue properties. The anatomical constraints couple the propagation of cardiac contours according to their relative distance. The propagation model comprises a weighted integration of a boundary segmentation model, a region model and coupling function.