An image pickup apparatus which is capable of changing panning control according to the shutter speed to thereby provide a shake prevention effect suitable for shooting conditions. A shutter control section of a microcomputer sets the shutter speed during shooting by the image pickup apparatus. An angular velocity sensor detects a shake of the apparatus. The microcomputer calculates the amount of correction of the shake of the apparatus. The shake of the apparatus is corrected based on the calculated amount of correction of the shake. The microcomputer determines, based on the set shutter speed and the amount of correction of the shake, whether or not the image pickup apparatus is in the panning condition. A panning control section of the microcomputer changes the panning control characteristic based on the set shutter speed and the amount of correction of the shake.