Item Frame Doesn't Empty

After putting down an item frame and placing an item inside it, it does not allow me to empty the item frame. When clicked, the subtitles do show 'Item frame empties,' but the item does not drop or empty.