Pick Block with items in your hand

When you hold a sword or a piece of armour in your hand. And you want to pick a block (with the pick-block-button), it doesn't work. Sometimes it does, but it would have to be a Diamond Sword in slot 3,7 or 8.