Unlike with Office 2008 where you have to use a special Uninstall application, it is possible to uninstall a new MS Office just draging it to Trashcan.
Added later:
looks like it will not remove all stuff installed before: see here for the list of files you have to delete manually.