You could try the likes of Farnell or RS, they have lots of different PCB mounting spacers.
A good alternative for you would be to use the threaded spacers.
They are basically a short tube with a threaded hole in each end. You need to put one screw (with a locking washer) in from the underside of the motherboard, and you screw the CPU board in using an extra screw from the top.
The spacer length is 17.5mm.