Creative flying slows down to walking speed

When flying in creative mode i randomly slow down to about walking speed feels even slower, it doesnt matter if im just going straight, mining and moving, flying fast, it allways puts me to this speed within a few seconds.

I need to stop and move up and its momentarily fixed again or it takes a few tries to get moving normaly again.