So from what you describe. I’m thinking it’s something to do with the video side of things. I wouldn’t think it’s Kickstart or RAM or even CPU. Why? As you describe things seem to be working in the background, such a floppy disk appears to be installing workbench.
Have you tried completely stripping down the A4000 to just the Mainboard only? Even taking out the Daughterboard/zorro 3 board?
Then just plugging in a RGB to SCaRT to see if you get the kickstart screen.