The memory access speed on the 3640 is pretty bad - even the 3630 is better - but you probably will have a net increase in speed.
There are
some issues to be aware of when using one in a 3000. Keep an eye out for heat-related issues as well. Commodore supposedly never officially sanctioned it for desktop use for that reason.