A lens-controlling device controls a first lens unit which moves for zooming and a second lens unit which moves for correcting the displacement of an image plane caused by zooming and for focusing. The lens-controlling device includes a memory which stores data for obtaining target-position information representing a target position to which the second lens unit is to be moved, the target position corresponding to a position to which the first lens unit is moved from a current position and a controller which generates the target-position information on the basis of the data and controls the movement of the second lens unit on the basis of position information of the first lens unit and the target-position information.