I did just that with my a500+, basically snapped the battery off with a pliers! (please dont do it that way). The only thing the battery is there for (at least on the 500 series anyway) is for the clock, so obviosley that will keep on resetting itself.
Works great now :-)