When players join my world there's a chance of them spawning with my inventory and removes what they had before they left

While in survival I have two friends that joined me and went to go do their thing. The other day when we logged on my friend spawned next to me when he didn't log off with me. We then discovered that he had my inventory. When my other friend logged on he had it as well. We lost several important items. Can this be fixed?