PC lag/freeze when cross playing with PS4 and Xbox

I have been playing cross-platform with friends on Xbox and PS4. The world is running off the person with the PS4 and very often my game lags probably around every 5 minutes, freezes the screen for a good 3-4 secs before returning back to normal. I have tested a single player world and I also experience the same lag.