If you are speaking of simple VGA/TV boxes, yes, they usually use HF, Composite, S-Video, sometimes also Component input.
The device AmiDude was pointing at, however, could possibly accept RGB over SCART *directly*. This would mean a big improvement in picture quality since there is no signal loss.
However, I am not sure what they mean with "SCART Input - RGB Composite". Hopefully this is *real* RGB input, leaving Amiga's signal unchanged.
I recently bought a TV box (scan doubler if you want) and was very disappointed with image quality. For games it this would be acceptable, but the picture was also jumping up and down 10 pixels. That's why I am also looking for a different solution.