A system recognizes an occurrence of offline action when a state in which a person-to-be-recorded does not perform a computer operation continues for or longer than a predetermined time. Then, action related information such as action schedule information about a person-to-be-recorded, movement position information indicating the position of a person-to-be-recorded, immobile target position information indicating the position of an immobile target such as a building, a point on a map, etc., position-action correspondence associating the immobile target position information with the content of offline action, etc. is acquired. According to the information, the content of the offline action is estimated. When a next computer operation is detected, the estimated content is displayed for confirmation by the person-to-be-recorded. The system accepts and records the input of supplement, amend, approve, etc. from the person-to-be-recorded.