Wandering traders and Illager patrols spawn in wrong places

Maybe it's my own perception, but I don't think that wandering traders should spawn inside buildings, because they do is wander, not trespassing your home; sometimes they do spawn over roofs over the water and their leashed llamas in another places.

Something similar happens with the Illager patrols, but fortunately they don't spawn inside my home, but they do on the water which is not suitable.