I don't really know anything at all when it comes to this, but shouldn't it be easier to do this as a P96 driver, that could then be loaded into the likes of UAE? Seems like it would make more sense than rewriting emulation from scratch - you already have the emulator, and you already have RTG hardware abstraction, and there's a fallback to the regular UAE window for apps that aren't RTG friendly.
