Nathan Godey(@nthngdy):🧵New paper: Matryoshka LM Suites Instead of training all models of a suite independently, we nest them within a single architecture and train the suite in a single run => much less compute, same performance Also allows free distillation, better speculative decoding & more 👇

2026.08.19 13:47

🧵New paper: Matryoshka LM Suites Instead of training all models of a suite independently, we nest them within a single architecture and train the suite in a single run => much less compute, same performance Also allows free distillation, better speculative decoding & more 👇

显示更多