Dedicated servers are amazing. I recently got one from softlayer.com. I have learned tons about Linux in the past few months (crash course basically, thanks Google) and setting up servers for web, as well as making sure they are PCI Compliant. A dedicated server is amazingly fast for hosting WordPress sites and other database intensive apps.
I had a dedicated virtual server from MediaTemple, which after playing with SSH, suddenly rebooted itself at random one day when no one was using it an