How can I uninstall software?

Seeing there are various ways to install on Ubuntu. What are the various ways to uninstall items? Which ways always work? How can I be sure something was uninstalled?