Portals to Outer End Islands not Working

Beat the Eder Dragon today. I just went back to explore the outer islands and the portal to the outer island does not work. I tried it twice, throwing an Ender Pearl into the portal. On both occasions, instead of being transported to an outer island I was transported to the return portal in the center of the main island about 50 blocks away.