That sounds like WinUAE's emulated floppy sound. You can adjust the volume to your preference but by default it's a little loud yet.
I actually like this feature of WinUAE, it really gives a feeling of working on an actual hardware Amiga.
It's the first thing I turn off.