I wouldn't mind owning something like a 5150, just for its historical significance.
But yes, early versions of windows were awful. Programs holding on to memory even after exiting them (this can happen with amiga too but it doesn't seem to be very frequent, at least in 3.1), an app crashing would bring the entire system down (win98 can sometimes recover, but it seemed to be exception rather than rule), system registry corrupting for no apparent reason, app's multitasking only with great pain (pretty good in 98, not good in 95, painful earlier), different types of memory making apps hard to run etc etc.
DOS is not very capable, but it DOES benefit from generally being pretty reliable. As long as you are only doing one thing at a time, and you can sort out the memory issues, you're probably better off, especially compared to win 3.1