It's possible to not use a router: you need one of your machines to have a 2nd network card, preferably your PC. You also need to be running some kind of gateway software, like Wingate, or an OS that supports routing - Linux, Windows XP, (Windows 2000?).
Considering the price of Wingate alone, you'd probably be better off with that router.
