A television audio signal encoder includes an up-sampler that inserts additional samples into a sum signal, a difference signal, and/or a secondary audio program signal to increase the sample rate of the corresponding signal or signals. The sum signal represents the sum of a left channel digital audio signal and a right channel digital audio signal and the difference signal represents the difference between the left and right audio signals.