An interior rearview mirror system for a vehicle includes an interior rearview mirror assembly having a reflective element having a field of view rearward of the vehicle when the interior rearview mirror assembly is attached at a portion of the interior of the vehicle. A directional information display is viewable to a driver of the vehicle. A compass sensor is preferably disposed in the mirror housing behind the reflective element such that adjustment by the driver to set the rearward field view of the reflective element moves the compass sensor in tandem with movement of the reflective element. The interior rearview mirror assembly comprises a video camera having a field of view that encompasses one of (i) the windshield of the vehicle and (ii) the driver of the vehicle.