A power supply apparatus and a power supply method are described, wherein the non-polar characteristics of the electrodes of a capacitor is utilized to improve the energy utilization efficiency of a battery through reciprocating switches of polarity connection between the battery and the capacitor. The voltages of the capacitors can also stay at a near constant level using the polarity reversal mechanism.