Water does not show behind ice

Place a water block in front of something else (eg. dirt) and then ice in front of the water, then looking horizontally through the ice will show the block behind the water and not the water.

Image compares looking at water through glass and ice.