@Effy, I think the topic here is to write a hardware driver for an existing RTG system like CGX or P96. Writing an entire RTG system yourself will end up in a lot of work without any comparable result.
CGX and P96 are established and have proven compatibility with most Amiga applications. Your own RTG system yet has to do so.
Bye,
Thomas