it can handle CGA signals, and that's the same as the RGBs signal on the Amiga. It'll work just fine.
CGA is RGBI and
not the same as the Amiga's RGBs output! CGA is a digital output and Amiga RGBs is analog.
http://en.wikipedia.org/wiki/Color_Graphics_Adapter9/10 times when it says "CGA->VGA adapter" it is a mistake. They actually mean analog "RGBs->VGA adapter".