But I do belive it is the job of Gayle to control at least the internal floppy?
Ah. Nope, that's Paula. Gayle does the IDE controller. (
Link)
The onboard serial ports of the Amiga are pretty slow. I don't know if the SX32 has an enhanced one, but adjusting your Serial prefs on the 600 may help speed things up.