A method of reducing background noise during optical character recognition includes conducting a first recognition pass over image data at a sequence of character positions to frame and recognize a first set of characters while a second set of characters remains unrecognized. Character skew is tracked based on the first recognition pass. The image data is modified to remove background noise based on the tracked character skew. A second recognition pass is conducted over the modified image data at the sequence of character positions to frame and recognize the second set of characters.