A surrounding pixel reference unit reads out and stores image data having a predetermined size from a line buffer. A color judgment unit detects the color of the image (reference image) stored in the surrounding pixel reference unit. A parameter determination unit determines parameters used in an individual noise removal unit on the basis of the color detected by the color judgment unit, and supplies them to the individual noise removal unit. The individual noise removal unit reads out, from the line buffer, an image which is located at the same position as that read out by the surrounding pixel reference unit and has a size according to the parameters supplied from the parameter determination unit, and executes a noise removal process for the readout image in accordance with the parameters supplied from the parameter determination unit.