Pick Block Does Not Work in Survival

When using a controller or mouse, middle clicking on a block in survival does not bring the block out of the inventory into the player's hand. Instead, it only works in Creative Mode.

To Reproduce

Have a block (e.g. Oak Planks) in your inventory, not your hotbar. Look at a placed block (e.g.Oak Planks) and press the Pick Block button. The block that was in your inventory is not moved to your hand.