You are required to open your Amiga to install the IDE adapter, and modify its case slightly in order for the IDE cable to be able to stick out from the case.
If you want a "cleaner" connection, then you need a PCMCIA controller (e.g. CD1200 or Squirrel SCSI) or a SCSI external port that mounts in the free expansion slot next to the floppy drive.