An image processing apparatus and method wherein consecutive image data is input, the image data is divided into blocks each constituted of a plurality of pixels, a motion vector of each block is detected, a border block is judged in accordance with the detected motion vector, the border block forming a boundary area between an object area and a background area corresponding to a background of the object area, and image data in the object area is extracted in accordance with the judged border block.