A vehicle management system has an operation controller for controlling an operation of a vehicle by receiving a signal in a vehicle side mobile communication terminal provided at the vehicle, and an operating side mobile communication terminal capable of transmitting a signal to the operation controller via a mobile communication network. The operating side mobile communication terminal and the vehicle side mobile communication terminal have weak radio transceivers, and a transmission/reception of the signal can be conducted with the weak radio transceiver. The operating side mobile communication terminal includes a human body information inputting section for inputting fingerprint information, the operating side mobile communication terminal or the operation controller conducts authenticating of an operator with the input fingerprint information, and the operation controller conducts the controlling on the basis of an authentication of the operator.