Yes remove the battery ASAP as it can and will ruine the RTC of the board. It can also ruine the SIMM slots. You may find if you replace the baord that it will not keep/hold time, this is due to the traces that were eaten from even the slightest battery leakage! I had 2 do that so I know.