Are you using an A3640 card for the processor?
If so, revision 3.0 of that card happens to be a really bad revision (all sort of problems) and also has been reported issues with Cybervision64/3D graphics cards. I learned this the hard way as I think it's the reason my CV64/3D kept crashing with OS3.9!