An image processing apparatus has an edge direction estimation section for estimating edge direction information for a first image area containing a notable pixel, an edge pattern selection section for selecting an edge shape pattern corresponding to the first image area corresponding to a predetermined edge direction estimated based on the edge direction information and pixel values in the first image area containing the notable pixel, an image enhancement section for enhancing the pixel values of the first image area containing the notable pixel, an enlarged image block generation section for generating an enlarged image area using the selected edge shape pattern and the enhanced pixel values of the first image area, and an image block placement section for placing the enlarged image area generated by the enlarged image block generation section according to a predetermined method.