A rocking horse has two arcuate members or rockers which can held in spaced relation to a supporting surface during a portion of the rocking cycle by stirrups. During this portion, the rockers can move with respect to the stirrups and hence with respect to the supporting surface to take a step forward and/or turn. The horse moves using inertial forces inherent in the rocking motion and/or riding activity.