The lines all draw me towards something that isn't there. I guess if I were painting this scene I would have to add a subject, like a worker, but you've done well with what you had, and it shows thought.
I do agree that the colors are a bit harsh, at least on my screen.