A method, and program storage device apparatus for adapting multi-media presentations of various formats to a new format suitable for playback on a general scene description based playback system. More specifically, when mult-media presentations do not contain scene description components, such components appropriate to the multi-media presentation will be constructed. The multi-media presentation will then be presented together with the created scene description components to the playback system for decoding rendering.