A system and method for retrieving multi-speed data streams is described. The data streams are stored within a central memory containing a plurality of memory modules. A first embodiment provides for creating multiple timeslots and segments for accessing a memory module within the central memory. A second embodiment provides for buffering data streams to equalize the rate at which all the data streams are stored and retrieved from the central memory. An implementation of the second embodiment is described where unused timeslots are allocated for sending data from a memory module to a transmitting port.