...how can I overcome this problem?
You might want to check your BIOS settings. They're accessible before Windows begins loading usually by pressing the {DEL} or one of the {Fx} keys. If the screen doesn't tell you how to do it, check the manual. Once on the settings screen, go to the BOOT tab and move the floppy down in the boot order. With XP you could easily make the CD drive the first in boot order and put the floppy after the hard drive.
Also try putting your computer into Hibernate mode instead of using Turn Off. Hold down the {SHIFT} key when you get the Turn Off dialog box and "Suspend" becomes "Hibernate." This will save you a lot of time when you restart your computer. You should be up and running in about 30 seconds.
HB