Uncontrolled movement while mining

I play on Xbox one and when I mine my character just starts moving but I am not doing that on my controller. It has gotten worse over the past couple days and has gotten really annoying. Sadly I can’t take a video or picture of this because I am writing this on my phone. I don’t not believe this is a problem with my controller because I’ve had this controller for about a month now and I have talked to a couple of my friends and they have been experiencing this bug as well. This has gone from a mere inconvenience to a very annoying problem.