An image processing apparatus estimates an estimated object region including an object on an input image on the basis of a stored object data, obtains a similarity distribution of the estimated object region and peripheral regions thereof by at least one classifier, and obtains an object region coordinate and a template image on the basis of the similarity distribution.