I know guys that did this with the TI-99 system. So long as the driver can handle the load, the port provides DS0 through DS3, and you have the right cable or the right jumpers set on the drives themselves, then this is possible.
I think most drives will tri-state their I/O when not selected, the the load issue should be moot. Should.