I can only drag things in game, I cannot click.

Whenever I go to open my inventory, I cannot click on blocks I can only drag them to place. I cannot delete blocks via the delete X (in creative mode). This also occurs on my realm and on servers.