Items are dropped when trying to put them in off-hand slot if not allowed for off-hand

Steps to reproduce

1. Grab an item that usually can't go in the offhand 
2. Then place it in the offhand slot and then it will fall out of your hand

Observed results
Items get dropped on the ground

Expected results
Nothing should happen (like in 1.19.30).