The present application is directed to a devices and methods of spacing apart vertebral members. In one embodiment, the device includes a plurality of stackable shims that includes at least a first shim and a second shim. The first shim includes a body with a first portion of a male-female connector, and a removable guide that is attached to the body and extends along at least a portion of the body and outward beyond the body. The second shim includes a second portion of the male-female connector, and a longitudinal passage that extends through the body and is sized to receive the guide. The second shim is moveable relative to the first shim with the guide disposed in the passage between a disengaged position and an engaged position. In the engaged position, the first shim is stacked on the second shim.