That block diagram seems to almost describe a complete computer. Why even bother with the Amiga part?
I've always asked myself the question: Why? Add a graphics card and a sound card, and you've got a PC with a 680x0 CPU. Not cool 
Keep it Amiga, guys 
Dont worry are just fantasies, people starts with accelerator cards and ends with another more "amiga friendly" system.