levels disappear after death in realms game with keepinv on

Sometimes when I die in a private Realms server with a few friends, all my levels disappear. If I then try to relog without restarting the game, I cannot access the game under error code 104. It is then fine again once I fully restart the game. It's possibly only happening through /kill inflicted deaths..