There is provided a musical tone generation control system which enables the user to obtain a feeling of operation as well as to obtain a feeling of satisfaction as if he or she were aggressively participating in performance or playback of a musical composition or the like. The musical tone generation control system has at least one operating terminal that can be carried by an operator. Each operating terminal detects a motion of the operating terminal caused by an operation of the operator, generates motion information based on the detected motion, and transmits the generated motion information to the musical tone generation control apparatus. A musical tone generation control apparatus including a tone generating apparatus that generates musical tones generates performance control information for controlling musical tones generated from the tone generating apparatus based on the received motion information, generates vibration control information based on the generated performance control information, and transmits the generated vibration control information to the operating terminal. The operating terminal generates a vibration corresponding to the received vibration control information.