I have tried without a floppy,and the first time I booted I got it all, Yellow than Purple than Black.
Egads! That does sound a bit hosed. :-( Usually, the Amiga will pick a fault color and stay on it. (I've never seen one leave a yellow screen to go to another color -- the only way out is a reset)
For a laugh, though... Power the machine up, wait about 20 seconds, and then try cycling the CAPS LOCK about 20 times. Most likely after about 10 on/off cycles (twenty presses) it'll freeze, as well. (The CAPS LOCK light will stop responding) In my mind, that would be the final test to eliminate a simple display failure as cause of your problems...
I actually also got a CD32 with SX-1 component which I'll try and the week-end. If it possible to conect the hard drive on that? (alhought workbench or rom might be different).
If you can physically/logically connect it, the contents of the HD should be fine for a CD32. Workbench revision would be compatible. :-) Of course, the startup-sequence may need both HDs in order to properly finish.