A unified framework is provided for building common functionality into diverse operator control units. A set of tools is provided for creating controller configurations for varied robot types. Preferred controllers do one or more the following: allow uploading of configuration files from a target robot, adhere to common user interface styles and standards, share common functionality, allow extendibility for unique functionality, provide flexibility for rapid prototype design, and allow dynamic communication protocol switching. Configuration files may be uploaded from robots to configure their operator control units. The files may include scene graph control definitions; instrument graphics; control protocols; or mappings of control functions to scene graphics or control inputs.