Endermen attack without you looking at them.

Playing on Windows 10 & it seems that Endermen trigger to attack you even if your not looking at them! This caused some serious problems while trying to fight the ended dragon. We was considering buying a realm but this has put us off massively.