Well first off I have to say that I'm certainly no expert!

Just a guy with an opinion, which I'm willing to share. I can definitely understand the feeling of walking around for hours and never having those elements line up for you, and while I do think that the more experience you have, the better chance you have of finding 'the shot' where less experienced photographers would have walked right past.. sometimes things just don't line up.
I respect you're desire to break away from the herd, and work for your results rather than flipping a coin and hoping where ever you plunk down your tripod will be a great composition. I think your attitude and willingness to do it the 'wrong way' because you enjoy it, is the best way to improve your photography.. so keep it up.
I also agree with your idea of shooting the milky water anyways, even if your hard work didn't provide you with the 'perfect' foreground.. I would have done the same. Now the next time you go back (or the next, or the next...) when the sky explodes with colour, you'll have this experience to draw from and have that much better of a chance of getting it just right.
Lastly, please realise, in my opinion these images are FAR from 'failures'! as I said at the beginning of my first post "they are nice images", and I do mean that. No they're not amazing.. but you knew that even when you were shooting them. The important thing is you got out there and took them, and considering you did work to find a good foreground, you basically did everything well on your end, your choice of exposure, shutter speed, focus etc, are all spot on, therefore regardless of the fact that everything didn't line up like you'd wanted, they're still nice images, and I'd be happy to look at nice images of this quality all day, in the same way you'd be happy to shoot the milky water for the same reason.