I don't think there is a new version of the Amiga app. You could always choose from serial or TCP/IP. It defaults to TCP/IP if it finds bsdsocket.library. But you can force it to serial in the icon information.
On Windows side you can right-click the Amiga Explorer icon and select Properties (not Setup). There you can switch from Serial to TCP/IP and vice versa.