Entities of players and mobs stay after leaving/Exploding

When players leave the server, it seems their entities stay where they last logged out. This also seems to occur when Creepers explode.
Most of these "players" are people who have since logged out and the creeper inside the building which is frozen.
This is client side, when asking any other players that had been on when they logged out, they reported seeing them also. I tried relogging which did clear it.