A2630 without its Fast RAM is slow because other expansion RAM is 16-bit wide while the A2630 one is 32-bit wide, plus it is directly connected to the CPU while the other memory is accessed through the Zorro II bus and that increases the latency...
The system shouldn't crash with 2 + 4 MB of memory, strange issue, I am sorry I can't help about that :-(