Efficiency still works on unmineable ores

I was using efficiency stone tools when I noticed that the pickaxe mined emerald and diamond ore very quickly. I found this very strange as I thought that even if it had the efficiency on it the ores would still take a while to mine.