Possible, but yet the driver probably wants to limit itself to specific chipset. Or at least I doubt the same driver works for every and all USB cards there is...
There's only three types of PCI USB chipset (EHCI, UHCI and OHCI), and there's generally one driver for each. There's a flag in the PCI config header that specifies which sort of chipset it is, so the appropriate driver can be used. No need for board-specific drivers, so no need to worry about the actual vendor and product IDs.
Once you get outside PCI-land, this is less true. Various embedded platforms have their own USB host controller and need their own driver, but unless you're working on ARM you're not likely to ever see one.