Connect to friends games cross platform, but experiencing lag

Im having problems connecting to friends games, long loading times before I can get in. But when I can actually join, players have noticed that my character stays in place even when I'm moving around, and I cannot break blocks, place blocks etc.