The present invention relates to a jotting implement that infers hand-jotted information from viewing a jotting surface and environmental landmarks. The hand-jotted information is any information marked on the jotting surface as a result of writing, jotting, drawing, sketching or otherwise operating on the jotting surface as well as hand-generated information produced by moving the implement in the air with respect to the jotting surface. The jotting implement has a nib for jotting and an arrangement for determining when the nib is jotting on the jotting surface. Further, the implement has an optical unit for viewing an environmental landmark and the jotting surface. The implement has a processing unit for receiving optical data of the environmental landmark and the jotting surface from the optical unit and determining from the optical data the physical coordinates of the nib with respect to the jotting surface. The environmental landmark is preferably made up several beacons that emit electromagnetic radiation and are affixed to a host structure.