@Hattig
I guess the chunky modes could have a P96 driver created for them.
Although making a P96/CGX driver would be a great idea there are chances no one can do the task (lack of DriverDeveloperKit or simply skills).
Existing chips supported by P96/CGX are well documented (like CirrusGD5446 or Virge) so it could be possible to emulate the behaviour of the gfx chip so existing drivers work without changes. I hope implementing the gfx chip would not require a lot of accuracy, just the minimum to open screenmodes and make blitter work, the important part would be register compatibility, the rest could be reimplemented as developers choose.
Cirrus Logic Linux drivers seem to be more or less well commented so it's not hard to see the addresses of the registers and their functionality. I'm not saying making a complete svga chip with a FPGA is easy, but Amiga drivers probably don't require to have a perfect VGA chip emulation (no need of emulating segmented memory layouts, no need of some VGA registers and screenmodes unused by P96/CGX drivers...)