Hello,
According to the pictures I can find, it most likely is the
oscillator crystal. Normally it should be 50mhz (for a
50mhz '060) but if you stick a fan/heatsink on the cpu
you could probably overclock to 60 or 65mhz without
any problems.
I'm not sure where to get a replacement, but they shouldn't be
hard to find.