When chameleons polymorph, they retain their same number of hit dice and hitpoints. So while you may be facing a minotaur or an arch-lich, it’s a very fragile one.