IMHO the dumb part in USB is the strict master/slave role on device level. It'd be much more flexible if it used a more peer/peer approach like e.g. Firewire or SCSI - maybe in another universe... ;-)
But then again, the strict slave logic is what makes USB devices so cheap and successful.