So once again, by pure magic, it works again. I did nothing other than had it off for a couple of days. I just got my Radeon 5450 in and tried it, booted right up. Put my Polaris 11 card in again, booted right up. I just don't understand this machine sometimes?!
I am not joking, I did nothing other than power it off a couple of days, swap cards (keeping in mind I had been swapping cards before the 5450 came in), and Poof, it works.