People get really defensive over this subject, especially if they have put a lot of blood, sweat, and tears into their own photography businesses. I tend to relate photography to the music business...because aspects of it are similar.
First you have the "bar band." These are the guys that have fun, play their music, and get paid enough money to buy a new guitar every now and then. I've been there and I knew I wasn't going to play arenas, but it was fun making money while it lasted. This is also me with photography. I take photos for friends and family and occasionally have a paying customer. I wouldn't mind if my business grew, but I won't have my dreams crushed if it doesn't.
Secondly you have the bands who relocate to a good music town and have a part time job while trying to really get their name out there. The best they usually hope for is opening for a big name band and they pull in some decent money, but not enough to not also have a part time job. I'd say this is the majority of professional photographers who are serious about their craft.
Lastly, you've got the big time bands that make it. Congratulations. I'm also sure there are lots of exceptional photographers out there who excel at what they do and make enough money to live comfortably, if not better than they would at a desk all day.
I know that their are photographers out there who loathe the part timer with the new camera for Christmas. My opinion is that if their pictures are good enough that someone will pay money for them, then it can't be all that bad. The next time you have a night out at the bar with the guys/girls and are digging the music, be sure to remember that those guys aren't "professionals."