A disk drive is disclosed wherein if multiple retries beyond a threshold are required to recover a data sector during a normal read operation, the data sector is added to a marginal sector list. During an off-line scan, the data sectors in the marginal sector list are verified. If the verification of a data sector fails, the data sector is relocated.