I don't see a problem with using unencrypted connection. You'll still be using SSL for sensitive data, i.e. online banking, paypal, etc. so that data will be encrypted.
The only problem IMHO might be someone using your internet connection or, worst case, trying to get to other devices on your network if you have any, like mediaserver or whatever... If these last things don't concern you (most internet sevices are unlimited nowdays anyway) it should be fine.