How to Install Anything in Ubuntu Part I: The Package Manager

There used to be a popular tutorial for beginners about this titled How to install ANYTHING in Ubuntu!, however it has not been updated since 2006 and it is a bit outdated (some of it still applies though). This is why I decided to start writing a guide which should cover pretty much anything related to installing applications in Ubuntu.