From what I understand (I could be wrong) it sounds like Aros 68k drawing functions are all chunky based and so it has to do C2P every time it updates the screen.
This will make it slow on AGA, probably best to just target RTG. AGA users could just use the AROS ROM and boot to 3.9.