A framework for providing user interaction with one or more networked devices. The invention allows for user configuration of networked computers such that each of the networked computer input and output devices interact with one another in a prescribed manner. The configuration associates relative geographic relationships for each networked computer using agent modules located on each networked computer that keeps track of the current location of a cursor based upon the geographic relationships. If the current cursor position corresponds to another networked computer, an agent module blocks incoming input streams so that they are not processed by the local computer, and transmits the input device signals to a remote agent module corresponding to the remote networked computer. The remote computer agent module injects the input device instructions into the remote system, which causes the remote computer to process the input stream from the local computer.