Can't "pick block" flower pots with flowers

When trying to "pick block" a flower pot with a flower in it, with the intention of gaining the flower pot item, the system places the flower in the inventory over the pot itself.

I would love to be able to pick either the pot or the flower based on where my cursor clicks.