A method of tracking an object moving relative to a scene includes generating a background image by acquiring a plurality of images of the scene and comparing a pair of comparison images with the background image. Potential objects are matched by comparing spatial characteristics of potential objects of a following image of the pair of comparison images with spatial characteristics of potential objects of a preceding image of the pair of comparison images to match potential objects in the following image to potential objects in the preceding image and each matched potential object is treated as a moving object to thereby track the movement of each moving object relative to said scene.