As was mentioned, the silly stuff on the web about going "manual" to be the goal of a GOOD photographer, is silly and shows lack of knowledge.
The various modes all have different purposes.
Think of them like tools in a tool box. You then select the best tool for the job.
You don't use a hammer, to pound in a screw. You use a screwdriver, to screw the screw in.
Same with modes. Most of the time I use P, but I will freely use S, A and M, as the situation calls for it.
What you have to learn is when to use which modes, and why.
Back to your question.
Basically you will NOT loose any image quality going to M.
BUT, that presumes you know about exposure and how to use M mode.
Example, if you shoot a pic of your 4 year old child running in the house. If you shot it a 1/15 sec, your child will be a blur. This is because you did not use the M mode properly, you set the shutter speed too low.
Example2, but you can also do that same mistake in S mode, by setting the shutter speed too low.
Anything other than Auto or P requires more thought on the part of the photographer.
Gud Luk