A technique for marking scene changes within video files. A video file with multiple frames is stored on a data store connected to a computer. Initially, the video file is received by an encoder or other processor. The frames of the video file are analyzed to identify scene changes between frames. Each frame of the video file includes a field that is marked with scene change data. Within the encoder, fields of frames are marked to represent scene changes.