A method of resizing an image having a plurality of data unit blocks is disclosed. Each data unit block is a pixel matrix. The method includes the steps of generating column pseudo-pixel matrix corresponding to a data unit block, decimating/interpolating the data unit block in column direction to generate a scaled column-pixel matrix, filtering the scaled column-pixel matrix and the column pseudo-pixel matrix to generate a filtered column-pixel matrix, storing the filtered column-pixel matrix in a first buffer, generating a row pseudo-pixel matrix corresponding to the filtered column-pixel matrix stored in the first buffer, decimating/interpolating each the filtered column-pixel matrix to generate a scaled row-pixel matrix, and filtering the scaled row-pixel matrix and the row pseudo-pixel matrix to generate a resized row-pixel matrix.