Either those were proposed image formats for the AAA Hombre chipset or they were mixing up HAM with ANIM formats.
Neither. These aren't different display modes. HAM5 is just HAM6 with 5 bitplanes. Similarily HAM7 is HAM8 with just 7 bitplanes.
They were mostly used in scene demos I think.