Lodestone Compass points to wrong place while Inventory UI is open.

My lodestone compass is connected to a block near my base... and while no menus are open it points just fine... but when i am in the inventory screen it tends to point away from the block and while in the inventory screen, picking up to move the compass from one place to my hotbar causes it to temporarily lose focus of the blocks location...