No! That's not an IDE port! Something will break if you try to attach a hard drive to it. You need to get a new IDE cable with three connectors on it - One will go to the motherbaord, one to your old drive, and the last to your new drive.
Another solution is to get a 4x IDE adaptor and 2 IDE cables. Should have the same result.
Also make sure your power supply can handle having 2 drives in the machine.
