Portable virtual reality is disclosed. A digital camera captures an input video stream comprising video frames that carry information about a surrounding environment limited by a field of view of the camera. The input video stream is processed by a handheld computer coupled to the camera. Parameters that define a rendered scene of a virtual environment are adjusted based upon motion parameters extracted from the input video stream by the handheld computer during the processing.