Rules are applied to video surveillance data to detect events. Localization of the events is achieved by decomposing events into distinct components, each of which can, in some embodiments, be defined at different locations and by different users.