Pan-scan is provided for a standard 4:3 aspect ratio TV displaying a 16:9 aspect ratio high definition (HD) video stream using the motion vectors that are part of MPEG-encoded streams. Specifically, if, for instance, the MPEG motion vectors indicate an object rapidly moving to the left, the left-most part of the HD video frames are shown, instead of remaining centered on the HD video frames and cutting off the left and right portions.