I don't trust Amigas as long term or reliable, and don't get me started on hard drives. However, 4GB CFs will be around for a while, they're damn cheap, and it's easy enough to make a backup of your CF card once you've got it set up the way you want it and write it back to a new card should yours fail. Newer CF cards last a whole lot longer than the original ones, I doubt an Amiga's use of one could wear it out.
CF also draws WAY less power than a hard drive, so if your 1200 is accelerated and running the Indivision and all on an original Amiga power supply, it's nice to take some of the load off.