To cause damage while turned off, the power would have to spike high enough to arc across the open switch contacts.
It's not impossible, but I suspect that you'd see damage in devices that were powered up on the same circuit long before that would happen.
