Anyway i've manged to get the thing configured and compiled, it's just the linking stage. At first i had undefined references to _atof and _pow. adding lib/libc.a and libs/libc_p.a cured this but now i'm getting undefined references to _ixemulbase. I'm building with the -noixemul options so i presume it's trying to staticly link it.
Then someone screwed it up and some parts were compiled without -noixemul switch.
Try adding -Wl,-Map=project.map to linker options and try to check out where it is trying to link against ixemul. Remember to link using gcc, not with ld directly, and remember to use -noixemul for both compile and link options.
Tho libnix for OS3 is quite old and probably not updated for years and might lack stuff...