A system and method for removing impulsive noise from a digital signal are disclosed. The system and method determines either a neighborhood maximum and/or a neighborhood minimum for a pixel of interest. The intensity of the pixel of interest is then compared to the neighborhood maximum or the neighborhood minimum to determine whether the pixel of interest should be replaced.