Massive FPS drop when looking downwards

When looking downwards there is a massive FPS drop (from about 30 to 10). Also there is a drop altogether except when looking downwards it is the worst (1.5.1 FPS for me is about 80 but in the 1.5.2 pre and 1.6 snapshots it's gone down to 30).

*This affects Survival and Creative.