A system and method for facilitating non-linear viewing of media is provided. The system facilitates non-linear viewing of media by providing a scene selector that scans a digitized media and selects a scene in the digitized media and a metadata generator that produces metadata associated with the scenes and relates the metadata to the selected scene. With the scenes annotated with metadata, a playlist generator can generate a playlist of related scenes based on user inputs like queries and a playlist updater can adapt the playlist based on user reaction to the displayed scenes. The scenes can be displayed on a variety of devices exhibiting various levels of intelligence. The displays can be distributed as can the system.