Elytra taking durability repeatedly making the new swap armor sound

Whenever the elytra takes durability damage (432 -> 431 -> 430 etc) it makes the swapping armor sound (the little shuffle) every time it takes that damage. Very annoying when every seconds you hear the armor swap noise while flying.