My main PC is a system similar to yours and AFAIK no AGP card will help you because flash is CPU intensive and not GPU.
Try to upgrade your CPU to the fastest your motherboard can handle.
You can also add a plugin like VideoDownloadHelper to the Firefox.
With it you can copy the video stream link of the YT video and redirect it to a video player like VLC and watch it without any problem and speed loss.