Potion Arrows in offhand are not used with infinity, but still provide for the enchantment.

When using a Bow enchanted with the Infinity enchantment, and having a Potion Arrow (eg Arrow of Slowness) in the players Offhand, the bow will not consume the arrow, and instead treating it like a standard Arrow, and firing a normal infinity arrow.