Interactive multi-view video presents new types of video capture systems, video formats, video compression algorithms, and services. Many video cameras are allocated to capture an event from various related locations and directions. The captured videos and any associated audio streams are captured in a video beam format which allows for the efficient and expedient search of the vast amount of data in real-time and allows the data to be stored for off-line access.