A physical response record system includes a main unit and various sensors for recording driver's conditions and vehicle operations by a driver. The driver's conditions in combination with the vehicle operations are used to determine a risky situation of the vehicle based on an averaged driver's condition and the like. The risky situation is further analyzed for detecting a risky object and stored as a record for later use.