A three-dimensional position and orientation tracking system uses accelerometers to measure acceleration of a moveable object (e.g., a head-mounted display unit or a data glove). A tracking processor generates both position and orientation information on the object relative to a simulation environment as a function of the acceleration data. In one embodiment, a simplified radar-based tracking system is disposed relative to the object and periodically provides additional tracking data on the object to the tracking processor. The tracking processor uses the additional data to correct the position and orientation information using a feedback filter process. The position and orientation information signals generated can be used, for example, in a simulation or virtual reality application. Position and orientation information is received by a simulation processor relative to the object. The simulation processor modifies a simulation environment as a function of the position and orientation information received. Modified simulation environment information (e.g., video and/or audio information) is then presented to a user.