Models doing Software and Mathematics have had the benefit of instant verification loops. Science is an intrinsically physical endeavor.
AI is going to radically change how we do science. We're building facilities where models can execute the entire research process and learn directly from reality.
We learned models have theoretical scientific knowledge, but miss critical details in physical laboratory work.
They pipette frozen samples, contaminate DNA, fail to account for evaporating solvents, and vortex open containers.
But can they do science in the real world?
To answer this we made SciUniverse [Level 1], a scientific benchmark that spans the research process including protocol debugging and bring-up, instrument operation, data analysis, and longer horizon tasks.
In 12 weeks, we built a research facility that is run entirely by AI.
AI designs, executes, and observes experiments end-to-end across biology, chemistry, and materials science.
We’re introducing SciUniverse: a benchmark that measures AI’s ability to do real-world scientific research.