Detecting a fire, such as a fire in an aircraft cargo bay, includes receiving a plurality of frames of video information, determining an energy indicator for each of a subset of the plurality of frames, and detecting the presence of fire in response to the energy indicator for each of the subset of the plurality of frames corresponding to a predetermined pattern as a function of time. Detecting a fire may also include comparing energy indicators for each of the subset of the plurality of frames to a reference frame. The reference frame may correspond to a video frame taken when no fire is present or a video frame immediately preceding each of the subset of the plurality of frames. At least some of the subset of the plurality of frames may be provided by a camera having a sensitivity of between 400 nm and 1000 nm that may generates 640.times.480 pixels per frame. At least some of the subset of the plurality of frames may be provided by a CCD camera or a CMOS camera. At least some of the subset of the plurality of frames may be provided by a camera having a sensitivity of between 7 and 14 micrometers, which may be an IR camera.