IIRC, the math libraries are used in machines without math co-processors (68881 and 68882). I don't believe Workbench's GUI requires much number crunching. Applications like Digital Universe, Distant Suns, Vista Pro, ray tracers, etc are performance-dependent upon the quality of the libraries or co-processor.
It seems back in my A500 days, some of the enhansed and optimized math libraries on Aminet made a noticable difference.