Off-hand has a different items position when compared to main hand in first person

Item on off-hand has a different position when compared to main hand in first person, this is very noticeable when you holding a sword on main hand and off-hand (by using /replaceitem commands), the position isn't consistent as some item will have a much higher position (for example, swords) while the other will have much lower position (for example, totem)

Steps to reproduce:

1. Disable view bobbing
2. Give yourself a Diamond Sword and hold it in your main hand
3. Run: /replaceitem entity @s slot.weapon.offhand 0 diamond_sword
4. Now compare it, notice that the items position in off-hand is much higher (or lower) than the main hand

Expected results:
Both off-hand and main hand items uses the same position.

Observed results:
Off-hand items has a different position and isn't the same as the main hand one.