I would suggest buying a film SLR (single lens reflex) camera and a long zoom for starters. You can pick up a Minolta XG-M or other X- series camera body and a MD mount 28-200mm macro zoom lens for about $100 if you time it right. No more than $130.00 USD. If you are going to do scenic/landscape photography, invest in a tripod. If you're going to be shooting action shots, get higher speed film (ISO 400 or greater). For dusk/pre-dawn or night photography, get a cheap flash. And get a good, simple book. Kodak produced a small 3x5 inch 100 or so page booklet on tips to improve your photography, or some such. Wanna really get into it deep? Buy Ansel Adams' book 'The Camera' and 'The Negative', about $22.00 each USD at Borders or Barnes and Noble. And, of course, come back here with ALL of your questions.
Just my personal recommendations. Have fun and welcome to the fold.