A system and method to estimate the absolute coarse pose of a rigid body, and more specifically of an individual's head as captured by overhead wide-angle cameras, by integrating position and pose information. Position information ideally includes three-dimensional position information provided by range finders or derived from images captured by multiple cameras. The three-dimensional position information can additionally be employed to determine the anchored viewing ray for the object.