Anything is not quiet true, never plug a serial pc mouse in there. You will damage your Amiga.
Yes, you're right. More specifically, what I meant was that anything designed to plug into the Amiga mouseport (e.g., real Amiga mouse, USB or PS/2 adapter, etc.) should work at a base hardware level as a 2-button mouse without drivers.