With the exception of PS2 Mice and Keyboards, actually, you can plug and unplug from a live PC.
If your PC is an AT or XT, then maybe not, but for the current crop of modern PC's, you can plug in printers to the Printer port, SVGA Monitors to the Video Card, sound cables to the sound card, any USB device of Course, serial cables, firewire, cables for video devices, etc... It's all handled just fine. I teach InfoTech at a TAFE college here in Australia. We have a large screen and projector in my classroom, that they have never bothered to purchase a switch for, in order for me to switch from the PC's Monitor to the large screen/projector. I must have swapped from large screen to PC monitor over a thousand times now, and done it while the PC is powered on everytime :-D
No problems.
Further more I have watched classrooms full of students plugging peripheral devices one after the other, into powered up PC's. The MANUALS don't even tell you to power off anymore, half the time.
I have fried an Amiga 500 plugging things into it live, but never a PC.
So sorry, but based on a ton of experience and what is quite clearly become considered acceptable practice, I beg to differ.