Nathan Godey
@nthngdy
Post-doc at Cornell Tech
参加 November 2021
856 フォロー中 1.5K ファン
🧵New paper: Matryoshka LM Suites
Instead of training all models of a suite independently, we nest them within a single architecture and train the suite in a single run => much less compute, same performance
Also allows free distillation, better speculative decoding & more 👇
もっと見る
