Music Discs can sometimes continue playing even when removed from the Jukebox

I'm playing on a vanilla server with a friend and we were experimenting with Music Discs when Ward continued playing even though it was removed from the Jukebox

Don't know how to recreate the Bug