Nathan Godey
@nthngdy
Post-doc at Cornell Tech
๊ฐ์
November 2021
856 ํ๋ก์ ์ค 1.5K ํฌ
๐งตNew paper: Matryoshka LM Suites
Instead of training all models of a suite independently, we nest them within a single architecture and train the suite in a single run => much less compute, same performance
Also allows free distillation, better speculative decoding & more ๐
๋ ๋ณด๊ธฐ
