To obtain a noise eliminating device which is capable of efficiently separating a noise component from an image component to attenuate only the noise component. A noise eliminating device includes: a first input reading unit (101) for reading out input image block data of a predetermined block; a second input reading unit (102) for reading out reference data containing data in the vicinities of the predetermined block; an output reading unit (104) for reading out output image block data of the predetermined block; a comparing unit (105) for comparing a level of a difference signal representing a difference between the input image block data and the output image block data with a predetermined value; a retrieving unit (106) for retrieving retrieval block data correlating with the input image block data; a switching unit (107) for outputting output image block update data based on comparison results; an output writing unit (111) for writing the scaled output image block update data to an output image buffer (103); and a control unit (112) for successively carrying out setting of a plurality of predetermined blocks.