An audio enhancement system and method for use receives a group of multi-channel audio signals and provides a simulated surround sound environment through playback of only two output signals. The multi-channel audio signals comprise a pair of front signals intended for playback from a forward sound stage and a pair of rear signals intended for playback from a rear sound stage. The front and rear signals are modified in pairs by separating an ambient component of each pair of signals from a direct component and processing at least some of the components with a head-related transfer function. Processing of the individual audio signal components is determined by an intended playback position of the corresponding original audio signals. The individual audio signal components are then selectively combined with the original audio signals to form two enhanced output signals for generating a surround sound experience upon playback.