Breaking an active jukebox doesn't stop playing music

The bug

When a jukebox playing music is broken, it does not stop. The music continues playing from nowhere until another jukebox is placed in the same block space.

How to reproduce

1. Place a jukebox
2. Use any music disc on it
3. Break the jukebox
   →  Music continues
4. Place a random block like dirt where the jukebox used to be (nothing happens)
5. Break the block and place a jukebox where the old one used to be (music finally stops)