Every time I go to bed it says that my respawn point is set, I think the game is forgetting where I slept and if I die I will spawn somewhere else

Every time I go to bed it says that my respawn point is set, I think the game is forgetting where I slept and if I die I will spawn somewhere else my spawn point is very far away from where I sleep