"Keep the ISO as low as you can" is bad advice for a beginner as a general tip for shooting.
This is because from that point on the beginner will always see ISO as just a noise gain, a detracting element in their photos. That will make them keep the ISO low and will cost them shots, especially if they are shooting anything moving.
IT also closes their minds to the use of a higher ISO even in a lighting controlled situation, say for boosting the exposure on the background without needing a separate light for the background (or when its not practical or possible to use a separate light to light the background area).
Myself I think that it will vary depending upon what you shoot, but that you should always aim to use the ISO that will let you get the shot. Noise you can deal with in editing and furthermore resizing for web display or printing will remove a lot more noise from the shot. A good clean exposure at a higher ISO will give you better results than underexposing at a lower ISO; or underexposing and getting blurry detail because your shutter speed was too slow (you can't fix blur in editing*)
So vary it depending what you shoot - when I shoot macro most of the time my ISO is very low, I want a nice sharp clean shot and my flash is the dominant light source; further I don't mind a darker background.
If I'm shooting wildlife though, unless its a really bright day I'll oft start at ISO 400 or even ISO 800 and see what aperture and shutter speed combination I can get. I know I want at least 1/500sec - and ideally a lot more.
Use the ISO - its a very powerful tool and in most modern cameras you can get very good results - I'd certainly not worry about ISO 800 on modern cameras.
*at least not without spending hours rebuilding an area that might not even have any data in the shot or before or after shots to build from - ergo you're basically drawing in the fix.