A system and method for identifying a shape of an anatomical structure in an input image is disclosed. An input image is received and warped using a set of warping templates resulting in a set of warped images. An integral image is calculated for each warped image. Selected features are extracted based on the integral image. A boosted feature score is calculated for the combined selected features for each warped image. The warped images are ranked based on the boosted feature scores. A predetermined number of warped images are selected that have the largest feature scores. Each selected warped image is associated with its corresponding warping template. The corresponding warping templates are associated with stored shape models. The shape of the input image is identified based on the weighted average of the shapes models.