Amiga sound hardware was pretty much a 4 channel DAC + very simple muffler...I mean filter. Not even hardware controlled panning...just 2 pairs 100% volume wired left and right phono socket.
Even with AGA all they had to do was add more DACs and that would have been fine. In 1985 it was a genius idea really.