A method and apparatus for multi-rate encoding of video sequences. The input data stream is received at a first bit rate. A domain transformation is performed on the input data and the transformed data is encoded into a series of output data streams each with a different bit rate.