The Delfina is known to cause a lot of issues. Some users have been lucky enough and it seems their system tolerates well this card. Just search on any old enough Amiga forum, and you will find quite a lot of complaints like yours.
I am sorry i cannot suggest any solutions to your problem, rather than getting rid of it.
