A system and method for determining the similarity of music files based on a perceptual metric is disclosed. In accordance with one aspect of the invention, harmonic, rhythmic, and melodic components are generated for each of the music files. The dimensionality of the components is then reduced to six by a mapper. This reduction is part of what allows the present invention to process large collections of music files very quickly. The mapper maps the components to positions on two-dimensional feature maps. The feature maps are trained by a trainer. The top N positions in each feature map, along with their amplitudes, are taken as the representative vectors for the music files. To compare the similarity between two music files, the distance between the two representative vectors are calculated.