My fps drops at random down to about 40 fps when I’m just running around

My fps is very low it’s about 30-40 fps I’m playing on Xbox one s and there is not much going on in my world it’s just my little house and about 8 chests so I should not be having low fps. I was already talking to Microsoft support and I have tried all the trouble shooting steps and none of them have fixed. I don’t have this problem in any of my other games so I don’t think it’s a problem with the console. I bought the game about 2 months ago and have had this problem since I bought it. It would be great if you could fix it because it makes it really annoying to play