A control apparatus for controlling a driver driving an optical element of an image pickup device to adjust a focus position of the image pickup device in the capturing of an image of a subject, includes a focus position control process startup unit for managing a startup of a focus position control process, a focus position control process executing unit for executing the focus position control process that is started under the control of the focus position control process startup unit, and a startup condition adjusting unit for adjusting a startup condition of the focus position control process, based on a change in a saturated luminance count contained in the image captured in the focus position control process.