I'm not sure what steps you took, but let me guess at a couple. Overall, it looks a little too desaturated. The colors look kind of dead to me, especially the sky. Also, I'm thinking that you straightened the verticals. I think that the image needs at least a bit of convergence toward the top. The angled roof line, combined with the parallel uprights on the projecting corner actually create the illusion of divergence to me, which looks a bit weird.
Otherwise, it's an interesting take on a neat old building.
Allright, here's the rework. I put a little convergence back in there, but not as much as the original. I did go back and look at it, but thought it way to much. I also went full-color, no desaturation.