I move when I press the use/place button

I made a new world a few days ago, but I noticed today that I sometimes move forwards very slowly when i press the L2 (use/place button). It does not seem to be with spesific items in my hand. This is really dagerous when I'm for example on the edge of a ravine or lava pool.