Signs and Banner Can't Be placed near Cactus

You can't actually put down Signs and Banner Near Cactus. Normally. When you place it. It should break the cactus. Only works with /setblock. Right-Clicking will not work. Note: You can still place it on the Top but not near it. Not the Sides just only the Cactus near it