A lens control device, for controlling driving of a second lens unit for correcting image movement regarding movement of a variating first lens unit, comprises: a storage unit for storing data indicating the position of the second lens unit corresponding to the position of the first lens unit created for a predetermined focal distance; a control unit for generating information to control driving of the second lens unit based on the data, and for controlling driving of the second lens unit based on this information; and a distance detecting unit for detecting distance to the focus object; wherein the control unit restricts the range of the generated information based on the detection results from the distance detecting unit. Or, the control unit controls driving for the second lens unit to generate the information, and performs weighting based on detection results from the distance detecting unit relating to driving control.