Yes, definitely remove the battery if you are not planning on using it, especially if it's one of the original red barrel jobs. They absolutely leak and will at a minimum kill the real time clock; maybe even destroy some of the SIMM memory address lines which lie nearby. Don't put it off, I've seen too many A4000s with batteries that have destroyed motherboards!
