Player gets slowed down while using Eye of Ender in other dimensions

How to reproduce: Hold right mouse button while having Eye of Ender in your hand in any other dimension than overworld.

What is expected to happen: Nothing. Eyes of Ender can be only used in overworld.

What actually happens: The player gets slowed down even though no action is performed (eyes cannot be thrown in nether etc.) Also an animation is played when trying to use the item.