A tamper head having an elongated pyramidal or conical shape is used to construct rammed aggregate piers. The pyramidal or conical shape of the tamper head is more efficient at building up lateral earth pressure and provides for greater economy in the construction of the piers than available with existing methods that rely on tamper heads with flat bottoms and beveled sides.