Ok, so what do you have now, and what are their symptoms?
Without knowing what's going on with your system atm, anything suggested could only exacerbate the issues you're suffering with, not to mention make it harder to pin down their causes.
On the basics, platters will last longer before developing errors, but are slower and difficult to find in "low" capacities, especially new. Solid state such as SDHC and CF are readily available but tend to give up much more quickly than traditional platters unless you're paying out serious bank. USB.... Just don't go there unless you have to as far as booting goes, it'll slow your system down due to all the interrupts created during transfers and really offers you nothing over what you'd get with either CF or SDHC.