MLPs store facts in language models. Can we write them into Transformers without training?
New work w/ amazing team
@garctrob @ronnygjunkins @EyubogluSabri, Atri Rudra &
@HazyResearch gives a ✨closed-form✨ recipe for fact-storing, Transformer-ready MLPs. Accepted at COLM 2026!