Villagers disappear frequently

Some of my villagers in a large artificial village will disappear frequently,which cause much loss,especially most of them are  "diamond" villagers.I keeping my difficult mode is "peaceful",and also there are fences to stop them from running away,but they still disappeared for at least 4 times in few days.Please solve this problem as soon as possible.Thanks.