An image processing apparatus includes an image pickup unit picking up an image with an image pickup device, a vibration amount output unit detecting vibration and outputting a vibration amount indicating a size of the vibration, a calculation unit calculating a first correction amount for reducing influence of the vibration to the image from the vibration amount output by the vibration amount output unit, a determination unit determining whether a zoom magnification ratio at a time that the image is picked up by the image pickup unit is equal to or higher than a predetermined threshold, a generation unit generating a second correction amount based on the first correction amount when the zoom magnification ratio is equal to or higher than the threshold value by the determination unit and a correction unit correcting the image picked up by the image pickup unit based on the first or second correction amount.