Peaceful doesn't work with ocelots?

Me and a friend accidentally cleared out a spot in the jungle and made coops for chickens, etc.
When we first added chickens a lot more ocelots started spawning in around them and in the area around it. It got a bit out of hand and now there's a lot more than we can handle running around.
We tried changing the server difficulty to peaceful but it didn't work.