Experience flies away from player when fishing

When fishing, the experience orbs will sometimes fly away from the player and float away. It's been happening to every player on our LAN multiplayer world, including the host. The video is taken from my PC, but the other players are on an XBOX One S.