Heh.. that's like putting a Ferrari engine in a Yugo. The A3640 has no onboard RAM - it's already throttled as it is, and that's only with a 25MHz 040. It'd be like sticking an 060 in an A1200 with no Fast RAM - it'll barely be faster than before.
There's more to a card than just the CPU.