Music keeps playing, after turning it off.

I was playing this new version of Minecraft and I immediately saw a problem - weird clicking, noises in the background. So I decided to shut down the music. Few seconds after I turned off the music, it started playing again!