註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Hyunjong Ok
@HyunjongOk
Google PhD Fellow | PhD Student at POSTECH
加入 November 2023
61 正在關注    102 粉絲
🚀 Stop using Transformers for weight-space programming If you are not training with gradients on a GPU, why default to a Transformer? When an LLM writes network weights directly, letting it also design the architecture achieves: 📉 ~1,800× fewer parameters at matched accuracy on ARC (AI2 Reasoning Challenge), compared to the best Transformer the same LLM wrote. ⚡ Up to 17× faster GPU inference with a memory architecture built for these tables, compared to a Transformer of the same size. 🧵 Paper & code at the end 👇
顯示更多
0
21
343
47
轉發到社區