A semiconductor memory device includes a semiconductor substrate, and a first magneto resistive element separated from the semiconductor substrate, and including a first magnetic layer and a first nonmagnetic layer. The first magnetic layer and the first nonmagnetic layer are formed in a direction perpendicular to the semiconductor substrate.