The disclosed embodiments relate to a system and method for maintaining synchronization between a video signal and an audio signal that are processed using clocks that are locked. The system may comprise a component that determines at least one initial level of a buffer, a component that determines at least one current level of the buffer, and a component that determines an amount of drift by comparing the at least one initial level of the buffer to the at least one current level of the buffer and adjusts the clocks to maintain the initial midpoint level of the buffer if the amount of drift reaches a threshold level.