A mechanism is disclosed for managing a distributed computing system in which a plurality of services are provided by a plurality of members. Initially, one of the members of the system is elected as the global master for the system. Thereafter, the global master selects a service master (where a service master comprises a member of the system) for each of the services provided by the system, such that each service has an associated service master. Each service master may be selected based upon an associated set of service master selection criteria. Once selected, each service master manages requests for the service with which the service master is associated. In this manner, services and the requests for the services are effectively managed.