every now and again when I join a world my controller connects to two different characters and swaps between them every now and again.

When I join a world do some work then get off, sometimes when I get back on my character is somewhere I was way beforehand. and then the next time I get back on I get back to my state before I got off the first time.