註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Zephyr
@zephyr_z9
AI & Chips | Not Investment Advice | DYOD
加入 August 2023
724 正在關注    148.4K 粉絲
"early access" Scammy vibes If it's really a sub-quadratic sparse attention arch (SSA), then serving this should be really cheap No point in putting this behind early access
Introducing SubQ - a major breakthrough in LLM intelligence. It is the first model built on a fully sub-quadratic sparse-attention architecture (SSA), And the first frontier model with a 12 million token context window which is: - 52x faster than FlashAttention at 1MM tokens - Less than 5% the cost of Opus Transformer-based LLMs waste compute by processing every possible relationship between words (standard attention). Only a small fraction actually matter. @subquadratic finds and focuses only on the ones that do. That's nearly 1,000x less compute and a new way for LLMs to scale.
顯示更多
0
78
971
28
轉發到社區