Remove it ASAP! It is leaking. It will kill your RTC and SIMM slots if it hasn't already... You can replace it with the new NiMh 3.6 volt types. I got mine from eBay, they are drop in replacements.
You can carefully clip the legs to remove it for now, or the best way is to remove the MB and unsolder it from the underside.