Have you any other computers you could try the site with? It's possible it's a provider issue, maybe an overloaded DNS or something. Also, if you have a router and/or broadband modem, check your settings, maybe reboot them and see if things improve.
On the other hand, it could simply be "one of those things" with IE...