Yep, it's definitely time to remove that battery. If you don't mind
your Amiga not keeping the correct time and date, you don't really
need to replace it with a new battery, but simply remove the old one
and you're all set.
;-) You will still be able to set correct time and date, if you really
wish, but after powering down the system, your settings will be lost.
I suppose if you wanna use that Amiga 4000 for some heavy expansion
and connecting to the internet as well, it may be worthwile to
actually install a new battery. Look for an Ni-mH type, as these
unlike Ni-Cd do not leak even after they are dead. :-)