A method and apparatus are disclosed for generating and maintaining enhanced background models for use in background-foreground segmentation. Background models are modified to contain an indication of objects that are typically stationary. Thereafter, if an object moves and has been previously identified as an object that is typically stationary, the object will not unnecessarily be identified as part of the foreground during background-foreground segmentation. In an exemplary implementation, moving objects are classified into two sets. A first set includes objects that typically move independently and a second set includes objects that are typically stationary. Generally, once an object is assigned to the second (stationary object) set, the object will remain in the background, even if the object is moved (normally, movement of the object would cause the object to become part of the foreground).