A vehicle-based video system includes a video processor, a plurality of electronic sensor interfaces that are operable to receive image output data from a plurality of sensor devices and at least one electronic vehicle interface that is operable to communicate with a vehicle communication bus. The video processor generates display signals for displaying video information for viewing and use by a driver in the vehicle for normal operation of the vehicle by the driver. The video processor is operable to fuse data from at least one imaging device and at least one non-imaging device into a single database in a standard format. The video processor, in response to processing the fused data, provides at least one output signal for conveying information to a driver in the vehicle that is used by the driver in the vehicle when the vehicle is being driven by the driver in the vehicle.