A couple of cheapy hosts I use are
www.hostprince.com as well as the stripped down godaddy.com hosting plan (stripped means you get all the programming languages, but the stats reporting is thin). You should be able to grab either one of these for less than $4/month.
Of the two, hostprince.com (btw, this is not my reseller site or an affilate redirect - somebody actually named their company this - go figure
) is my preference. AwStats for reporting,excellent response time (somewhere around 40ms last time I pinged it), Fantastico install for Wordpress - all that for $2.95 mo.