You cannot format a disk with XFS because XFS does not know which format to use. That's documented. You did read the documentation, didn't you ?
If you want to format a HDF for usage with XFS, you either have to temporarily change the mountlist to use FFS instead of XFS, or use another virtual disk drive, e.g. DiskImage. Or format the HDF with UAE.
Bye,
Thomas