The present invention provides improved techniques for spatial representation of data and browsing based on similarity. For example, improved techniques for spatial representation of image data and browsing the image data based on the similarities (or dissimilarities) of the images are provided. In one embodiment, a hierarchical MultiDimensional Scaling (MDS) database for a set of images is provided, which allows for computationally efficient querying and updating of an image database. In one embodiment, techniques for modifying an MDS database for images are provided to allow for more intuitive browsing (or searching) of the images.