Cannot respawn to the Main Spawn point after death when it's out chunked

What I was expecting
When I died and pressed "Respawn", I would be teleported to the Spawn point, even it's Away.

What happened was
I need to click several times to Respawn to that area, or I keep going back to the death place and not to the spawn point. It also takes long before you can move because everything is vibrating and spinning.