Village bell and surrounding buildings respawn and remove changes when the save is reloaded.

I moved into a village to try and redesign it. I removed the bell, surrounding buildings, and tore up the ground for the village center. I then redesigned it completely. 

When I reloaded the save later, the bell and buildings were back and my changes were gone. I could see some stuff like a corner of the pond I made, but the rest had disappeared.  This has happened 4 times.