I think the "toy" part is possibly a reflection of the times the Amiga was commercially succesful and to a degree Commodore wanting the Amiga to be Commodore64-The Sequel. Back in those days computers were regarded as toys geeks/nerds played with (the fact that videogames were thier main home use probably contributed to this a bit) by the general population. The Amiga500 was by far and away the most popular Amiga sold, and although it could be used for a lot of other stuff, it was considered a games machine. Most of Joe Public with no real interest probably do vaguely remember the Amiga as "oh, they had good games back in the 80's".
The irony here is that a big, clunky, heavy pc with either monochrome or cga display + beeps was considered a "serious" machine. Also perphaps a touch ironic is that the Amiga's real charms didnt really surface until after it's era of dominance. (sure, for it's time an ocs/ecs amiga had some impressive software, but for me at least the Amiga experience didnt really start maturing until ks2.x/wb2.x and a harddrive were involved, and only really starts shining with '030+fast ram+Ks3.x/OS3.x).