Do you mean it doesn't close itself, or you can't close it even if you press the close button? If the close button doesn't do anything then there is a process still running in the shell that hasn't exited. If this is the case, then run the LHA extraction, leave the shell window open, then open another one and type "status". This will tell you if any programmes are running that you can't see.
--
moto