Whaat?
The C-64's PSU is definitely not suitable!
The CD32 expects +5 and +12VDC, the C-64's brick gives +5VDC and 9VAC.
IIRC the 1541-II/1581 PSU is compatible, but be sure to measure the voltages with a multimeter first so that you're sure they're on the correct pins.. Don't just go plugging it in.