The movement of an imaging of a background in a sequence of images of a scene determined. A combination image is composed with pixels which have been built up through combination of several consecutive images. Along with the combination image, a change image is calculated which indicates position-dependently to what extent differences arise between successive images contributing to the same area in the combination image. Corresponding areas in an input image and in the combination image are searched for. This is done depending on the change image, such that a probability that an area in the combination image is found is less according as the change image indicates that the changeability of the are is greater, for instance by selecting, for the purpose of the search, for what areas in the combination image corresponding areas in the input image will be searched for. From the locations of the corresponding areas, the movement of the background is determined.