I don't like not having a battery. The only real problem is all of the files you save will have the same, useless, date without a battery.
I prefer changing to a coin type battery, that can be easily changed when needed. Just make sure you add a diode in that setup.