Mending with armor + pickaxe

When mine armor with mending is full durability and I hold my pickaxe in my hand also with mending to repair it all the xp goes to my lvl's instead to pick's durability. Only when I take my armor off will it start repairing my pickaxe