Hi.
apt-get remove package will remove "package". However, you will need to
be careful. Open Office is closely integrated in Ubuntu's Gnome.
Removing it will leave you with a broken gnome. Make sure to notice all
the packages apt-get removes so you can install everything again.
Kenny