A method and apparatus for adjusting brightness of an image are provided, in which number distribution information of pixel brightness is detected, and the brightness of a specific area of the image is adjusted using characteristic values according to a distribution characteristic of the detected number distribution information. Accordingly, a decrease in an image recognition characteristic of a human being is compensated for in a specific area, such as, low-brightness area, of an image.