To me only thing that comes to mind regarding layers is that they are very dangerous to performance, just like the current bottleneck for 3D in OS4 IIRC was the extra 2D layer (i.e. MiniGL constantly calling P96).
Not saying that it can't be done or anything similar, it just reminds me of that right away...