A battery retaining system for a children's ride-on vehicle. The system includes a retaining member that is selectively movable between a first or nominal position in which the retaining member blocks removal of a battery assembly from the body of the vehicle, and a second position in which the retaining member does not block removal of the battery assembly. The battery retaining system also includes a biasing member coupled to the retaining member and configured to urge the retaining member from the second position toward the first position.