Going in scaffolding can cause you to interact with the last thing you hover over

As seen in the video, I hovered over a block and went through scafolding which caused me to place that block at the endpoint even though it would normally be physically impossible. Same goes for the chest when I exited the scafolding at the top which caused me to open it.