The memory expansion slot is accessed from underneath the A500. Just remove the rectangular plastic lid and connect your memory expansion to the pins on the side.
Some memory expansions come with a clock. This clock need a battery for when the system is powered off. And batteries don't last forever.