Horses duplicating on a server

When I was playing on a server I was riding a horse. I logged out without getting off first and then I logged back in, and what I found was another replica of my horse. I did the same thing again and another horse was there.