Still fear of de-soldering lol
If going at it with a soldering iron scares you that much, you don't even have to. You can simply snip it off, or as someone else said, wiggle it repeatedly until the tabs break and it comes off. It looks like it has already started to leak so you should wipe the area with a bit of vinegar on a cloth to neutralize the alkaline electrolyte and then wipe it down again with a cloth slightly moistened with clean water.
The pads where the battery installs are quite robust and there is nothing particularly sensitive in the immediate region. Even a complete amateur stands a good chance of attaching a new battery without damaging anything.