very cool result showing how wet lab data enables a specialized model to beat gpt-6 astra at a task at the frontier of science!
in general scaling is great and obviously i am a believer in it, but probably the more we approach the frontier of science, the more specialized data matters and that gives task-specific models a chance. this specialized data is usually private and is probably a real moat
it should be in principle true that a task specific model will probably do better at scientific discovery just because it can use more of its parameters for the task you care about
顯示更多
We built high-throughput materials labs in Menlo Park to create a loop between experiments and models. The labs generate fresh data, the models learn from it, and then help us decide what to try next.
Using only 1,300 H200s, plus months of our experimental data, we mid-trained and RL’d an open-source model to surpass GPT-6 Astra on our analysis benchmark. We call it Neon.
This is real footage from our lab. We’re focusing first on hard problems in materials science, including superconductors, magnets, and semiconductor materials.
Read our blog posts below.
顯示更多
