Chunk loader wont turn off

I built a mob switch with a minecart chunk loader 2 chunks away. When i turn on the lever (to turn off the chunk loader) and leave, no mobs spawn. The chunks just wont unload, even though no minecrafts are going through the portal and i left the area. I even tried relogging but it didnt help.