A system to allow a conferee defined as a nuisance source to respond to an automatic nuisance decision of a Multipoint Control Unit is disclosed. For example, a conferee placing a conference on hold may generate on hold music, which may be identified by a nuisance detector. The nuisance detector sends an indication of the nuisance condition to a control unit in the MCU. The control unit mutes the signal coming from this conferee and sends an Interactive Voice Response (IVR) message to the conferee. The message may inform the conferee that he has been muted and requests the conferee for example to press one of a plurality of touch tone keys depending on his situation. For instance, the conferee can select particular keys if he is returning from the hold condition, if he is experiencing a noisy line/environment and needs to reduce the sensitivity of the nuisance detector algorithm, or if he wishes to disable the nuisance detector algorithm.