So many new rumors about distillation which I don't fully agree and there are so many things that can't be explained by it. But it's great to see people building on top of each other.
Macaron V1 from
@Macaron0fficial is probably the first release that demonstrate how much potential GLM 5.2 has. By LoRA RL on top of GLM5.2 base model, it achieves SoTA performance.
A few interesting points:
- LoRA specialists trained with Mind Lab Toolkit
- Significant improvement on benchmarks
- Served with Mix-of-LoRA harness
- Open weight under MiT license
- Blog and hosted API available