In a face portion detecting apparatus, an image of an eye portion of a car driver can be properly extracted without adverse influences caused by a reflection image reflected from a luster reflection surface of spectacles worn by the car driver. The face portion detecting apparatus is arranged by a light source of an illumination for illuminating a face portion of a human being from different directions from each other; a camera for photographing the face portion which is illuminated by the light source; an illumination lighting control unit for controlling turn-ON operation of the light source; a camera control unit for controlling the camera in synchronism with the turn-ON operation of the illumination light source; and a retina reflection detecting unit for removing a reflection image of an article having a luster reflection surface by employing at least one image which is acquired by the camera in synchronism with the turn-ON operation of the illumination light source, whereby only a determined face portion is extracted.