Techniques are disclosed for projecting an image onto a surface suitable for interaction with a user while avoiding user occlusion, and while correcting for distortion due to oblique projection. The displayed image moves to a suitable surface at a suitable size and orientation as a user moves around an environment, resulting in a user-following interface. Surfaces are selected in which the projected interface is not occluded by the user or other objects in the environment. Displayed images may be interactive, and moved into an interaction area on a suitable surface that is convenient for the user. The interaction area may or may not coincide with the display area. Adaptation of the projected interface is allowed so that the content of the display and the style of interaction widgets are modified based on distance from the user and orientation of the user with respect to a projected interface.