I usually keep the adapter in and swap the CF cards, so far no problems for at least 10 years, maybe even more.
same here & never a problem. This is the best way for me since it's very easy to damage the PCMCIA port pins so jug removing the CF card is much easier and safer