An optical pointer includes a housing, a movable plate, a manipulable member and a displacement detecting unit. The movable plate is disposed in the housing and has a recognizable pattern. The manipulable member is manipulated by a user to transmit the movable plate to effect two-dimensional movement inside the housing. The displacement detecting unit is disposed in the housing for optically detecting the recognizable pattern of the moveable plate, and generating a control signal indicative of a displacement of the movable plate according to detected image change of the recognizable pattern.