This can be done without the need to log-out and redial?
Disable all the services except identd (auth). Click Save. Should work without redial.
and what if i need these services?
You don't. If you need something temporarily, enable it and click Use. If you need to set up FTP then you likely want to allow it for LAN ip ranges though.
I assume that there is no simple way to just close that port?
Disable the service. Click save.
[EDIT]Or was it: Close the window for 'use', select Save as default from menu to 'Save'? Been a while I used Miami...[/EDIT]