I'm guessing either your VIC's character ROM, or the particular area of RAM to which it is transferred upon boot, is corrupted.
The web site "DENIAL" is home to all of the VIC-20 experts/freaks/collectors. Someone there should be able to get you sorted.
It's not transferred to RAM upon boot.
