That keyboard is the rare "Doomy Editon" first release. Nice find!!!
The reason you were having memory issues with the A2620 and the GVP card is both occupy the 24-bit (8MB MAX) address space. Yes the A26xx cards use the 24-bit address space and NOT 32-bit like other cards...