Well that's really weird because my A3000D has no floppy connected and the 3.2 Kickstarts boot fine. And Paula never changed a hair on her head.
Interesting, maybe it's a 'feature' of the 4000D kickstart? I only have 4000s and both now have 3.2, but I tend to test from the floppy drive, so haven't tested it with it disconnected...