An image stabilizing device has an image restoration processor configured to perform image restoration process for stabilizing hand movement included in an input image by using an image restoration filter created based on hand movement information, and an edge emphasizing processor configured to perform edge emphasizing process for emphasizing an edge of the input image. The image stabilizing device has a stabilization mode determiner configured to determine an image stabilization mode for stabilizing the input image based on a size of the hand movement created by the hand movement information. The image stabilization mode includes a first mode for performing the image restoration process, a second mode for performing the edge emphasizing process, and a third mode for performing none of the image restoration process and the edge emphasizing process.