are you using the GLquake executable?
GLquake will run on the CV64/3D, but its just an intellectual excersize to see if it works, as all it does is a pretty biliniear filtered slidshow. the Virge chip isn't fast enough for games.
some people have been fairly handy with a soldering iron and replaced the virge with a virgeDX with mixed results.
best bet is to either use software rendering (which the CV64/3D will speed up tremedously compared to AGA), or if you must use 3D Hardware, get a cybervisionPPC at least, or some kinda voodoo3/PCI combo.
software rendering is fairly reasonable. was able to play quake on a lan game with an A4k, 040/40, CV64/3D, and not get my ar5e kicked. at about 17-20fps at best

this might help compare hardware and speeds:-
amigaspeed