In an abnormal shadow detecting system, a characteristic value on the shape and/or the density of a prospective area of a micro calcification shadow set in an image of an object is extracted on the basis of image data representing the image of the object, and whether a micro calcification shadow really exists in the prospective area is determined on the basis of the calculated characteristic value.