Nathan Godey
@nthngdy
Post-doc at Cornell Tech
加入 November 2021
856 正在關注 1.5K 粉絲
🧵New paper: Matryoshka LM Suites
Instead of training all models of a suite independently, we nest them within a single architecture and train the suite in a single run => much less compute, same performance
Also allows free distillation, better speculative decoding & more 👇
顯示更多
