Killing a mob always gives you a rare loot (100% chance).
Killing a mob that has a rare drop, like Zombie Pigman or Wither Skeletons, you'll always get the item the mob drops as a rare drop.
Also, it doesn't have a link with Looting since you get the same result with unenchanted weapons or even by punching mobs.