A modular implant system includes a set of anatomically-designed diaphyseal fitting and filling modular implant components and adapters for connection to another implant component such as a modular articular component, a segmental component or an intercalary component. The other end of each diaphyseal component is a tapered porous surface. The tapered porous surface is received with a tapered bore in the bone diaphysis that is prepared to match the size and shape of the tapered porous surface. The diaphyseal implant is easy to insert and remove, does not bind before fully seating, and is designed to prevent stress shielding. The diaphyseal sleeve eliminates the long lever arm created when fixation occurs only at the tip of the stem, and should therefore eliminate related stem loosening.