Jerry Liu(@jerrywliu):MLPs store facts in language models. Can we write them into Transformers without training? New work w/ amazing team @garctrob @ronnygjunkins @EyubogluSabri, Atri Rudra & @HazyResearch gives a ✨closed-form✨ recipe for fact-storing, Transformer-ready MLPs. Accepted at COLM 2026!

Jerry Liu

@jerrywliu

ML & numerics @HazyResearch | ICME PhD at Stanford, @doecsgf fellow | prev @berkeleylab @duolingo

加入 May 2022

695 正在關注 691 粉絲

Jerry Liu@jerrywliu

2026.07.22 17:23

MLPs store facts in language models. Can we write them into Transformers without training? New work w/ amazing team @garctrob @ronnygjunkins @EyubogluSabri, Atri Rudra & @HazyResearch gives a ✨closed-form✨ recipe for fact-storing, Transformer-ready MLPs. Accepted at COLM 2026!