This has been tried. I remember years ago it was decided that the logic onboard the A3640 is not reliable at any speed much beyond 33mhz even if a faster CPU is used. I doubt you will hurt anything by trying, but it almost certainly won't work for any period of time.
Jeff