This invention provides a method and apparatus for processing video data containing a plurality of video tracks. According to an aspect of this invention, new modified data is generated by modifying part of the plurality of video tracks. After that, play list data to control the video data playback sequence to play back the generated modified data in place of data of the part is generated.