Not every colour dithers well, and IIRC it only works in one of NTSC or PAL effectively.
The other issue is that the C64 has limitations on the colours that can be on screen.
Some games went the other way, and switched palettes rapidly to get extra colours in sprites, etc, such as cyan.
