No software support (class- and device-specific drivers)
Not enough power on the ports of Amiga-specific USB solutions (the typical 2.5 watt doesn't cut it)
Not enough bandwidth, assuming the above restrictions were solved (an 800x600 256 colour screen refreshed at a sluggish 15 fps would already push to the max a Deneb under an 68060).