An image compression system and method is described, which makes use of the symmetry found in faces and heads to perform the compression. The image is divided along the line of symmetry, and pairs of corresponding pixels on the two divided sides are determined. A weighted average and a weighted variance of the pixel values of the pairs is computed, and is used to encode the image. A transform such as the Karhunen-Loeve transform is used to compute the weighted averages and variances.