Cannot use items when looking at a fence

Whenever looking at a fence with a usable item (a Steak for example, and yes, I made sure that I needed food) you are unable to use the item. Instead, it looks like you are attempting to break the fence, but not actually damaging the it (first person).