Having a filled map in multiplayer causes a kick

Was playing on a friend's port-forwarded server when i got kicked (Internal Server Error) for picking up a map from an item frame. Joining back resulted in another kick, essentially banning me from the server.

I asked someone else, as well as the server owner to pick up a map, both of which also got kicked.

Once the map was removed from my inventory by the owner, i was able to join again