註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Tri Dao
@tri_dao
Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
加入 May 2012
665 正在關注    45.4K 粉絲
SSMs had the nice asymptotics but kept missing out on the inference goodies Transformers get for free like spec decode and quantization. Turns out we were just not caching the right thing. Same IO-aware trick behind FlashAttention, Mamba scan, paged KV. A lot of the big wins weren’t new architectures, just people taking memory IO seriously.
顯示更多
0
4
305
22
轉發到社區