If you run out of chip ram rather quick, you have to many visual add ons installed. Try typing avail in a shell window, and you will see that the fast ram is used. If you remove the accelerator you will run into the wall much, much faster than you do now.
What game is it you are trying to run? If it needs more than 1.8 MB chip ram, then you might run into problems. How much chip ram is free when you have loaded Workbench?