A method classifies an object in a scene as either an ambulatory person or a wheelchair user. Images of the scene are acquired with a set of stereo cameras. Moving objects in the scene are segmented from the background using detected edges. A 3D reconstruction of the object is generated from the edges, and tests are performed on height and 3D shape of the 3D reconstruction to classify the object as the ambulatory person or the wheelchair user.