Biggest one for me is that NZ has far fewer animals that are liable to bite, eat or otherwise mess you up.
Aus has a more diverse economy and is more right wing US leaning then NZ.
Guess it really depends on what you prefer, a mini america or somewhere in terms of climate and political landscape more akin to the UK.
Personally I'd go to NZ, but that's just me :-)