Hand punch/use animation can play in spectator mode despite not being initially visible

If you try and right-click a block, break a block, or try punch an entity in spectator mode, the hand animation will play even though the player's hand is not normally visible.

How to reproduce

1. Go into spectator mode
2. Look at a block
3. Hold down right-click/the 'use' key OR continue pressing the attack key
4. Press F3 + F4 to switch gamemode to either creative or survival
   → The end of the hand animation will be visible, indicating that it played when the hand is not normally visible.

Video:

MC-203041.mp4

Notes

Related to MC-46766