Hostile mobs linger in unloaded chunks

It's most noticeable when you switch between difficulties. When i switch from any difficulty that allows monsters to spawn, the mob cap still remains higher than zero. On the screenshot it says M:27 and Local Difficulty: 0.00 - peaceful.

Because of this mob farms don't work at full capacity.

The way i recreated it is like this:

1. Started a new world.
2. Travelled about 350 blocks in one direction with Easy difficulty.
3. Switched to Peaceful difficulty.
4. Boom

I mostly play on lower rendering distances - 6, 4. Always either 8 or lower than 8.