A portable electronic apparatus includes: a non-contact type integrated circuit module; a magnetic recording device including: a magnetic recording medium; and a magnetic head that is adapted to be moved from a predetermined retract position to the magnetic recording medium for writing or reading of information; a magnetic detection unit that detects a magnetic force; and a control device that is adapted to make the magnetic head retract from the magnetic recording medium to the retract position when the magnetic head is positioned above the magnetic recording medium in response to the magnetic detection unit detecting the magnetic force.