An illumination control system comprises a rotation detecting section, an abnormality determination section, and a filter removing section. The rotation detecting section detects the rotational driving of a filter which is located on a path of illumination light emitted from a light source, which irradiates color light rays having different wavelengths to an object, and which is driven by a rotational driver. The abnormality determination section determines whether status of filter rotation is normal or abnormal based on the detected rotation of the filter by the rotation detecting section. The filter removing section removes the filter from the path of the illumination light when the abnormality determination section determines that the status of filter rotation is abnormal.