alright, I'll take it apart and take a look.
If it isn't leaking, would you still recommend taking it off ?
What exactly do I lose if I remove it ? Just the clock ?
You don't lose the clock, it just has to be set to the correct time/date everytime you boot your Amiga. Not worth risking having it around even if it's not leaking-- think of it as a time bomb. You could go for the coin type non-leaking battery if your games save your high scores with date/time.
Those A500 memory expansion boards also have batteries in them that look the same as the pictures shown by another poster. They also go bad, and those metal things are hard to take apart to get to the battery but at least the A500/A1000 MBs don't have time bombs planted on them.