Interface doesn't open when holding right click and then looking past the block

Interface doesn't open when holding right click and then looking past the block. This doesn't apply to chests or ender chests.

How to reproduce:

1. Get a interactable block
2. Face towards the block
3. Look right
4. Hold right click
5. Then look to the left fast

Observed results: It doesn't open the interface.

Expected Results: It should open the interface.