It's not all that slow, IIRC, as the 68000 only accesses memory every other cycle anyway (I could be wrong on that, but I believe that's the case.) And the chipset only steals CPU cycles when the software specifically gives permission (and maybe in 6bpp video modes, but I can't quite recall.) The Amiga hardware reference manual has a lot of good information on chipset/CPU timing.