A method of finding an object in an image that consists of describing an object shape by one or more sets of feature points (220); estimating positions of the feature points (310); finding new locations for each feature point based on an appearance model of an aggregate appearance of the object in local neighborhoods of all features points (320); and constraining the positions of the feature points based on a shape model (330).