Yup, that was almost exactly what I was thinking.
It's a weird spot... the sun rises over and to the right there, and then sets back and to the left. On each side the sun in the early and late day is obscured by trees. There's probably only a period of like 11:00 AM to 3:00 PM where the sun is reasonably up above to illuminate everything in the shot more evenly, but of course then the sun would also be pretty harsh. CPOL would help, obviously, but I'm not sure how much. It's a bit of a head-scratcher.
I'm going to check it out again tomorrow mid-day since I'll be out and about and see what I can do with it. I'm actually experimenting with it now so I can try to nail it when the foliage turns more... you just never know when the best day will be for the combination of the foliage, the sky, etc.
I also wonder about maybe dawn/dusk. I'm figuring dawn would likely result in just a black bridge since the light woule be coming from the other side of the bridge... I'm not sure what dusk would do since the light would come from behind me but be kind of obscured from the trees... I think.
Of course... is the shot worth this is another thing I wonder about... it looks like a nice scene, I like the bridge and the water, etc... but is it good enough to bother???