There are new rumors that the next GLM Model, GLM 5.5, will have 2.5T - 3.5T parameters and significant architecture changes
In its August HKEX interim filing, Zhipu AI said it had validated the idea of Looped Transformers in preliminary experiments. I wonder if we'll see it implemented in the next GLM model