Its not hard. One thing you should do is keep practicing spellcasting as you go. Rest and cast again. The higher level you cast the more xp you get.
Try not to kill monsters with thrown objects. Take your time with melee weapons and build up your fighter levels.
A trick I'm using is to only take 2 party members at first that way I don't use up food quickly.
Don't be afraid to retreat, you might get mobbed and at Level 4 monsters there are monster generators.
