My prefered host right now is digitalocean.com (Use this link to get $25 of credit) . It’s insanely cheap (as low as $5/month no commitment) and you get SSD servers. You can easily launch pre made images for Magento, wordpress, LAMP stack, etc. Simpler than Amazon’s AWS. However It’s only for people who are comfortable using SSH to do the remote admin. For non-geeks I recommend Godaddy.