A system for distributed information processing and interaction includes a plurality of output devices arranged to produce a respective output portion of a system output, a plurality of application processors and a state server in data communication with the plurality of application processors. Each respective output portion is defined by context information. Each application processor is configured to process one or more respective application programs and is responsive to the context information. Each application processor is coupled with an associated respective output device for controlling the output device in producing the respective output portion. The state server provides the context information to the plurality of application processors. The architecture is extended to a more general system in which output devices produce a variety of outputs including device actuations, as well as video displays, and receive a variety of inputs.