An image processing apparatus which associates a plurality of images obtained in advance for the purpose of panoramic image synthesis or stereo-scopic viewing display without troubling the user. Whether or not component images are to be associated with each other is determined with reference to the file names and attribute information of a plurality of component images to be synthesized without the intervention of the user.