I think using the same sky twice as well, doesn't help to make them realistic.
What software are you using for the sky replacement?
On the odd occasion I do it I use Luminar AI (Jeff does too if I recall). There's plenty options in there and you can create backdrops from your own photos too.