Each partition needs it's own buffers too, so if you really want to save memory keep it down to x2 partitions if possible. But really, advice like that should only be necessary for a 1MB machine, whereas you have 11MB with the ACA620, plus your 2MB chip memory.
What filesystem are you using?
Ah...so you're going to disable it sometimes leaving you with the SRAM card...I follow.