A method for adjusting audio playback is disclosed. The method includes storing audio packets in a jitter buffer, and playing out the audio packets at a first rate. The method further includes determining that a capacity parameter for the jitter buffer is out of compliance with a predetermined standard, and based on the capacity parameter, determining a second rate for playing out the audio packets. The method also includes applying a pitch-invariant time scale modification algorithm to change the rate of playing out the audio packets from the first rate to the second rate.