I just got another 1200, an NTSC model this time, and a damn nice one at that mind you!

The problem I am having is this.
When I boot up the system with the 2.5" HD that it came with, it boots fine and never expects me to put in a boot floppy.
On the other hand if I remove the 2.5" HD and replace it with a CF2IDE adapter then try to boot off of it, it will either boot as it should or it will ask for the boot floppy.
Sometimes I have to turn my machine off and on a few times before the Amiga realizes what it was designed to do in the first place...
To boot off the damn hard drive when a floppy is not present.
What gives?
Any thoughts?
P.S. None of my other Amigas do this, though they have floppy terminators installed where as this 1200 does have a floppy drive in it.