When in singleplayer, pausing causes mobs to loose track of you

After the 16w40a snapshot and I noticed there was a change with the new illagers, I decided to go fight them.

During a fight with an evoker I paused. But when I unpaused, the Evoker wasn't after me.

Not sure if this happens to other mobs but I guess this should be looked at