Fireworks become unusable when put in off hand

Only a couple items can be placed in the off hand with fireworks being one of them (i assume cause of how they work with elytras) yet when put in the off hand they will be impossible to be launched from the ground or used when flying an elytra.