A system and method for assessing a functional or medical ability of an actor in a environment. The method includes providing a plurality of data sources in the environment. One or more of the data sources are designated as providing information relating to a functional or medical ability. Data from the designated data sources is retrieved and forms the basis of a functional or medical ability evaluation. In one embodiment, a plurality of baseline function categories are established, with information from one or more of the data sources being assigned to at least one of the baseline function categories.