What's your Buster rev?
What version of CGX are you using? I'm using the latest version of 4 and haven't had any trouble. Also be sure that you're installing the right version (Z2/Z3) of the driver.
Failing that, try another slot? This is a strange problem...