Tags, such as XML tags, are inserted into email to separate email content from signature blocks, privacy notices and confidentiality notices, and to separate original email messages from replies and replies from further replies. The tags are detected by a system that renders email as speech, such as voice command platform or network-based virtual assistant or message center. For example, the system can detect the signature block or privacy notice tags and not render the signature block or privacy notice as speech. The system can render an original email message in one voice mode and the reply in a different voice mode. The tags can be inserted to identify a voice memo in which a user responds to a particular portion of an email message. Preferably, an email server that receives and stored the email message inserts the tags into the email. Alternatively, the tags could be inserted by an email client application. The tags are detected by an email parser, which can be incorporated into the system rendering email as speech, or, alternatively implemented in a separate logical entity.