Disclosed are a method of compensating colors in an image display device for users with color vision deficiency and a device of the same, enabling the users with color vision deficiency to view display images as vividly and naturally as normal users. The method for compensating colors in an image display device includes a step of determining whether a user is partially color blind or normal, and a step of controlling gain values of a plurality of color signals depending upon the user's color perceptivity so as to compensate colors displayed on a screen, if the user is determined to be partially color blind.