A rather expanded binary image and a rather blurry binary image are generated from a multiple-valued image. A ruled line candidate area is extracted from the rather expanded binary image, and the extracted ruled line candidate area is verified using the rather blurry binary image.