Nether Wart doesn't drop more then one when fully grown

When the nether wart is suppose to be fully grown (at it's tallest stage) and you break it it only drops one, but if you let it go back to the smallest stage and break it it will drop 2-4. Is it suppose to do that??????