Internet Speeds Drop Significantly when playing Single Player.

Hey everyone, I have a bug for you. When I'm on GTA Online, ROBLOX, Need For Speed Heat, The Crew 2, I can play those games just fine and listen to music on YouTube. However, when I play Minecraft, it tends to slow down my internet speeds.

When playing anything else my internet is at 18-25 Mb/s, however, when I play Minecraft, my internet is crawling at 5.5 Mb/s.

I am on Xbox Series X. What could be the problem?