Yes, it will.
The key file will be copied to your HD, the battery is only used to keep time when you turn the computer off.
I would recommend that you set the time before you load the email program. Simplemail will not download new mail on my PB if the time isn't set.
Enjoy...