A radiation or neutron detector wherein lateral side light detecting optical fibers prepared from clear optical fibers that are scraped on a lateral side to permit side incidence of fluorescence are used to detect the fluorescence from a phosphor or a scintillator such that the background to gamma-rays is reduced. If desired, the optical fibers may be bent at 90 degrees and guided to a photomultiplier tube in order to reduce the size of the detector. Fabrication and maintenance of the detector can be facilitated by adopting such a design that a detecting block comprising a detection medium and lateral side light detecting optical fibers is separated from a readout block comprising clear optical fibers.