Assuming I could, because I wasn't trespassing or something else, I think I would have moved a bit closer to the building. As this image stands, my eyes went right to the larger white flowers in the right foreground before I saw the "overgrown" building. Nevertheless, I think the subject has a lot of potential - different angles, different "framing", etc. I might also try a portrait mode image and bring some of that "ugly-looking" cloud into the picture. I am not sure how many shots you took of this building, but if I was shooting it, I probably would have walked away with somewhere around 10-20 images. I say this because a number of years ago, when I was on a flower photography workshop, the instructor always said "when you find a good subject, work it from as many angles as you can". I now apply this to just about any subject I am shooting, even landscapes.
Hope this helps.
WesternGuy