Switch bedrock cursor drifting in menus/inventory

After around 15 minutes of gameplay the cursor in the inventory and menus will drift in a random direction on its own causing me to reset the game, I’m playing on switch bedrock but have also had this issue on windows 10 but only using a controller. I am 100% certain that the issue is not my controllers since it doesn’t happen in movement, just inventory/menus also like o said it happened to me on Windows 10 with a different controller. Please fix soon.