As for creating them... the only tools I know of are the old Commodore ones (I've never used them). I'll have a quick nose around the DevCD tonight and see what they do!
Right.. the XL Toolkit 1.10 is on the DevCD. There's an AdPro loader/saver for CDXL. It also contains a load of command line tools and limited documentation on how to use them, but running with no arguments gives a bit of info.
XLMake looks like it quite simply takes a batch of IFF files and compiles them into a CDXL. It has an audio option but I don't really understand it.
XLAudio inserts audio into an existing CDXL, I think it needs to be an IFF file again, I'm guessing 8SVX.
I didn't try them out but if they don't object to your frames they should just work!
There appears to be a legally dubious archive of the XL Toolkit on
http://cd32-allianz.de/ under Entwickler - Einführung.