A technique for allowing a user to treat email addresses as objects both incoming and outgoing email messages is presented. A small icon is added to the text of each address which will vary depending on the pedigree of the address. The invention is not limited to single addresses. Rather, an entry denoting a mailing list could also be treated as an object and a unique icon could be employed to indicate the nature of the entry. For outgoing messages, the pedigree of the address or list is determined by monitoring where the user obtained the address. For incoming messages, the message header is parsed and searched to find addresses that match the receiving user's address book. If no match is found, a generic address icon is added before the text of the address, while the system checks the email header against other address sources such as server lists.