MLPs store facts in language models. Can we write them into Transformers without training?
New work w/ amazing team @garctrob@ronnygjunkins@EyubogluSabri, Atri Rudra & @HazyResearch gives a ✨closed-form✨ recipe for fact-storing, Transformer-ready MLPs. Accepted at COLM 2026!