An image processing apparatus comprises a first color signal detection section of detecting a first color signal indicating a color component of a pixel of interest from the pixel of interest, a second color signal detection section of detecting a plurality of second color signals indicating color components of a plurality of neighbor pixels located in a vicinity of the pixel of interest from the plurality of neighbor pixels, and a direction detection section of detecting a direction of an edge in the vicinity of the pixel of interest based on the first color signal and the plurality of second color signals. The color components of the plurality of neighbor pixels include at least three color components.