It's a fair argument that a religious ceremony should be about religion, if that's what they asked for.
HOWEVER, what on earth is "un-godly" about standing there taking photos? Is God bashful? Was God having a bad hair day or something? Photographing things isn't evil or a sin, and they weren't interfering with any of the ceremonial activities. Shutter noises? Is that the entire issue? ...really? The wind is significantly louder than the shutter noises.
Even if you're 100% sympathatic to the priority of religion, I still don't see how the priest still is making any sense.
Also, there's pretty much zero chance that a non-professional photographer set up a tripod with a camera right at the altar without anybody noticing or complaining about it before that. It's obviously a person they hired.