A portable terminal with a telephone or radio communication function, a call response message transmitting method and a server for, when the user cannot answer an incoming call, enabling the user of the portable terminal to inform the caller of his/her situation that does not allow him/her to answer the call. A portable terminal comprises a storage for storing information on different types of messages each being associated with an image in a prescribed pose or gesture and a camera section for shooting an image when a call is received. The portable terminal recognizes the pose or gesture from an image shot by the camera section, and selecting a message corresponding to the recognized pose or gesture from the storage, and transmits the selected message to a calling terminal.