FPS drops to 0, Have to press Esc and wait a minute before playing again

This never happend in 1.8, I could play while constanty staying between 20 and 30 fps (I set that as max framerate). But on 1.9 i't can go up to 60, but I noticed that the higher I set my max fps the more frequent these spikes are.

I have no idea why this might be, but I have attached the debug screen ad well as the [shift+F3] and [alt+F3].

Also what comes just before the spikes is suddenly alot of chunks unload, and then as it try's to reload them all it happens.

I would really like a fix for this since I can't play on 1.9 without pausing the game for a minute each 5 minutes.