Server texture pack.

THIS is SO annoying. When I I'm on a server, (let's say Mineplex) and I want to play one of it's games, (let's say Wizards) it says 'This server recommends a custom texture pack. Do you want to download it now?' If I press 'No' it disconnects me. If I press 'Yes' my MC client crashes. Help?