Piru summed it up very well there: if the evidence points on the hardware side of things you may want to look at your memory modules first.
I've had similar problems in PCs and faulty memory chips were the cause much of the time. I don't know if something like memtest exists on amiga, if you have a 486/early pentium relic lying somewhere you could test them there. Good luck!