It all depends on how much you know about websites...
The more you know, the less expensive it is. I am a computer programmer by trade, and I host 3 personal websites for a total of $4 a month. Not sure how much cheaper you can get than that.
Most web hosting services provide you with a generic website builder program that will alow you to set up very baisc looking websites. If basic is all you want, you could pretty easily host a website for $4 a month.
If you want to get a little more fancy, there are a multitude of products out there, many of which are free, that you can install on your web servers that will allow you to create websites without having to know any programing. There are CMS (Content Management Systems) that can be installed that give you a GUI that you can use to create webstie, and there are album software packages that will make hosting a professional looking site simple, the installation and File Transfering does have a learning curve howerver. You'll need to know basic database configuration and FTP support to get it to work, but once you have it installed and figured out its a snap. I use Joomla for my CMS, and JAlbum as my gallery software.
After that, the next step is to pay for hosting and configuration of your gallery, and depending on how much flexibilty you want, it can get pricy.