A refresh control circuit for use in a semiconductor memory device having a plurality of banks, including: a bank number signal generator for generating a plurality of bank number signals having a predetermined delay time between generation timings of the plurality of bank number signals based on a refresh signal and a reference signal; and a bank selection unit for generating a plurality of bank selection signals in response to the plurality of bank number signals and a piled-refresh control signals to thereby refresh the plurality of banks.