Assigning categories in that direction (contact --> E-mail message) makes some sense, but the other direction does not. Over the course of several years, all of your contacts would be tagged with every type of E-mail they ever sent you. Ridiculous.
Haven’t tried removing those categories yet.
I wonder how many people are using Outlook 2011 yet. It’s a buggy POS, and I’ve installed the service pack. If you try to empty a folder that contains more than 200 messages (like Junk), it WILL crash. Seriously it will crash about 80% of the time in that case, and this is on multiple systems.
Even worse, it appeared to have been involved a complete annihilation of my Address Book, deleting 500 contacts. Turns out it was some kind of corruption or interruption of Address Book’s access to its own database (which remained at 300K the whole time), which was shaken loose when I went to back up my iPhone and triggered a sync. My contacts reappeared (not by being transferred from the phone), although the “me” flag was removed from my own entry in Address Book, causing SpamSieve to allow a bunch of spam that spoofed my E-mail address as its source.