I'd remove it. If the machine hasn't been used a bunch, your use may push the battery over it's limit and cause a leak. Given the age it is ripe for failure.
I have an A3000D, I removed the battery and I can't tell you of any problems with the machine beyond having to manually set the clock if I want to timestamp files.
Bob