Minecraft ghost mode/adventure mode random toggle

This gamebreaking bug doesn't effect solo worlds, when friends try to join me they are unable to. And if i join them there is an repeating bug where you leave your player hitbox standing still and move around like a ghost, unable to break blocks or attack anyone. The gamemode is still survival in this mode. This fixes itself randomly but ive been stuck in this ghost mode for up to 15 minutes at a time when playing with a friend. Leaving the game does nothing but cause large lag and when i join back im still in this mode.