System, method and program product for protecting access to a portable memory or storage device. There can be detection if the portable memory or storage device is more than a predetermined distance from a reference location. If so, access to a portion or all of data within the portable memory or storage device is automatically prevented. The reference location can be the location of a computing apparatus which is authorized to access the portable memory or storage device. Also, there can be detection of lapse of a predetermined time the portable memory or storage device has been unable to communicate with a predetermined computing apparatus. In response, access to a portion or all of data stored on the portable memory or storage device is prevented. Also, there can be detection of lapse of a predetermined time since the portable memory or storage device has been accessed by an information processing apparatus in which the device is installed. In response, access to a portion or all of data stored on the portable memory or storage device is prevented.