Remember that most VGA graphics cards in those days meant a 256 color 320x200 display and still a 16 color 640x480 mode. In other words an 8-bit graphics display. We didn't really have a "bitblit" command or a real blitter or anything like a "BIMMER" until at least 1994-1995
One thing to consider is that a 486 with a VLB video card is easily faster than the Amiga's blitter. Kind of like how using fblit is generally faster on an upgraded Amiga, except moreso.
I'm not sure how far back 16/24-bit SVGA cards go. (When did VESA VBE 1.2 show up?) The thing is, in the beginning they were expensive just like Amiga gfx cards, hundreds of dollars. But by '96 I remember 1MB SVGA cards being $35 at the computer shows.