註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Xinyan Hu
@xyVickyHu
PhD student @berkeley_ai / @anthropic fellow / LLM safety and interpretability/ worked on econ+ML theory / graduated from @pku1898
加入 October 2022
649 正在關注    496 粉絲
Interestingly, one attention head can be important across five ICL task families! Our original thread gave an in-depth mechanistic analysis of addition ICL (quick video recap 👇). We've now generalized this to four more ICL task families, spanning both arithmetic tasks and semantic tasks! Our paper “Understanding In-context Learning of Addition via Activation Subspaces” has been accepted to COLM 2026! 🎉 See more details in thread. (1/N)
顯示更多
0
6
69
23
轉發到社區