Taking Random Clipping Damage

Everytime me and a friend plans on LAN, the one not hosting the world takes a random half-heart to a whole-heart of damage. Settings are on easy but its day time and no mobs were nearby to cause damage. Also we were standing still or walking on a flat surface when it happens