Depending upon the number of modules you run, and how poorly coded your SQL queries, Drupal can be a dog. Even a well-coded site can cause problems. It *loves* memory, especially if you are running Apache, which is not the most memory efficient web server in the world.
My experience with Drupal has encouraged me not to host Drupal sites until I upgrade my system hardware. YMMV.