Redstone torch wont pop off block when block is removed

Made a single player and was messing around with some of the new features but I noticed that when I broke a block that the redstone torch was connected to the torch. It seems to happen in random chunks.