Inventory does not open when player is significantly larger than the vehicle

To replicate:

1. Spawn a horse, tame and use a saddle. (Or use /ride on any entity)
2. Change player scale: /attribute @s minecraft:generic.scale base set 9
3. Try opening the inventory

If you change the size of the vehicle with /execute on vehicle run attribute @s minecraft:generic.scale base set 9 for example. Works as intended again.