An image pickup device is provided which includes: an auto focus control unit sampling contrast values as a function of a relative distance from an object by detecting a contrast of an image of the object while driving a lens in an optical axis direction, calculating a focused focal position on the basis of the contrast values, and driving the lens to the focused focal position; a shake detecting unit detecting at least an amount of shake in the optical axis direction of the lens; and a selection judging unit judging selection and non-selection of the sampled contrast values depending on the amount of shake in the optical axis direction of the lens at the time of the sampling. Here, the auto focus control unit calculates the focused focal position on the basis of the contrast value judged as being selected by the selection judging unit among the sampled contrast values.