The present invention comprises using error propagation for building feature spaces with variable uncertainty and using variable-bandwidth mean shift for the analysis of such spaces, to provide peak detection and space partitioning. The invention applies these techniques to construct and analyze Hough spaces for line and geometrical shape detection, as well as to detect objects that are represented by peaks in the Hough space. This invention can be further used for background modeling by taking into account the uncertainty of the transformed image color and uncertainty of the motion flow. Furthermore, the invention can be used to segment video data in invariant spaces, by propagating the uncertainty from the original space and using the variable-bandwidth mean shift to detect peaks. The invention can be used in a variety of applications such as medical, surveillance, monitoring, automotive, augmented reality, and inspection.