There is disclosed a decoder buffer capable of receiving streaming video data packets and storing the data packets in a plurality of access units. Each of the access units holds at least one data packet associated with a selected frame in the streaming video. The decoder buffer comprises: 1) a first buffer region comprising at least one access unit for storing data packets that are less immediately needed by the video decoder; and 2) a re-transmission region comprising at least one access unit for storing data packets that are most immediately needed by the video decoder. The decoder buffer, in response to a detection of a missing data packet in the re-transmission region, requests that the streaming video transmitter retransmit the missing packet.