A fuel pump for an internal combustion engine including a fuel pump housing, a cylindrical bore having a central axis and being defined by a bore wall surface, a receiving hole formed in the housing, and a tappet assembly received in the cylinder bore. The tappet assembly includes an outer peripheral surface with an elongated key slot longitudinally extending parallel to the central axis. A guide key partially received in the receiving hole is provided, the guide key including a head that extends into the cylindrical bore to engage the elongated key slot of the tappet assembly. The head has an outer dimension that is larger than a dimension of the receiving hole along the central axis. Methods for guiding a reciprocating tappet assembly in a fuel pump and assembling a fuel pump are also provided.