A method and system for time-motion compensation for use with head mounted displays is disclosed. According to the method, a remote camera captures an image for display on a head-mounted display (HMD) including a viewing window. The image and camera position data is transmitted to a system including the HMD for display to a wearer of the HMD. The HMD position is determined. An offset between the HMD position and a known position of the HMD is determined as is an offset between the camera position and a known position of the camera. The image is offset relative to the viewing window of the image based on the difference between the two determined offsets.