Thousands of chunks being loaded for some reason?

I'm playing a fairly light modpack on a server with some friends, with around 10 people on it. I read somewhere that the avg loaded chunks is around 4000; is there any way to reduce this? Please help me.