Elytra kills you when going to fast

I would use my elytra's in mid-air and would accelerate at fast speeds, but I would crash and there's nothing in my way and it's becoming annoying, now I can't travel at fast speeds because I'm afraid of that happening. But I want to do it. I think the video explains it best.