An interactive communications system is provided in accordance with the present invention. The system includes a component for analyzing sequential communications including speech, gestures and other modalities related to an underlying communicative intention. The component concurrently employs at least two of the communications in determining an action to facilitate achieving the intention.