Can't sync data back from xbox one to series x

Made a world on series x, had it sync to my one s to play in another room also. Now whenever on my series x it'll say "syncing data" but even after leaving it for about 20 minutes still hasn't fixed the issue.