A motion controlled handheld device includes a display having a viewable surface and operable to generate an image. The device includes a motion detection module operable to detect motion of the device within three dimensions and to identify components of the motion in relation to the viewable surface. The device also includes a motion response module having a first mode of operation and a second mode of operation. The motion response module is operable in the first mode of operation to monitor the motion of the device, to determine that the motion matches a predetermined mode selection trigger, and, in response to determining that the motion matches the predetermined mode selection trigger, to measure a baseline orientation of the device based on measurements of the components, and to switch to the second mode of operation. The motion response module is operable in the second mode of operation to monitor the motion of the device, to determine movement of the device in relation to the baseline orientation using the components of the motion, and to modify the image in response to the movement.