Liam Fedus(@LiamFedus):Our failures are our moat. A scientific paper is a clean repackaging of a messy process of failed syntheses, dead ends, hints of success. That mess is the durable asset: what was tried, what worked, what failed, and why. Compound it into weights you own. Frontier labs live by this principle. If tokens-in-context were enough, pre-training would have died years ago.

Liam Fedus

@LiamFedus

Building industrial-scale science at @periodiclabs Past: VP of Post-Training @OpenAI; Google Brain

加入 October 2012

1.2K 正在關注 36.4K 粉絲

Liam Fedus@LiamFedus

2026.07.12 20:31

Our failures are our moat. A scientific paper is a clean repackaging of a messy process of failed syntheses, dead ends, hints of success. That mess is the durable asset: what was tried, what worked, what failed, and why. Compound it into weights you own. Frontier labs live by this principle. If tokens-in-context were enough, pre-training would have died years ago.