Fishing sometimes gives nothing

I don't know if it's a bug or something secret about fishing but like half the time when the bubbles reach the bait, pull down the bait and make the sound, nothing comes out, while the other half of the time it works normally giving me fish, lilypads, etc. (just in case, I fish in a sea, not in a compact body of water)