Villagers keep on randomly going inside my house

I hate it when the villagers are in my territory!!!!! They just annoy me and they are not supposed to come in my house!!!!! THEY JUST SHOULD NOT BEEN IN MY HOUSE EVER!!!!!!!!!!!! FIX THIS OR ALL THE VILLAGERS WILL NOT LIVE IN PEACE AGAIN!!
P.S. Why can't I mark unreleased versions???