060 would allow you to listen to most mp3s, but still it would suck considerable portion of the CPU time and it would still be easy to get hickups and gaps by just doing something CPU intensive.
I prefer to use G4 @ 1GHz, mp3s take couple of percent CPU time there... plus I can watch all my movies with it.