GPT-6 Astraは、データから根拠のない結論を導く「過剰解釈(over-interpretation)」が減っているとのこと
使用感と一致していますね。ただ慎重すぎて融通が効かなかったり保守的すぎて何が言いたいのかよくわからない文章になりがちではあります。。。
Opus5.5は過剰解釈は結構まだあると思います
A new way to measure how AI agents handle the routine analyses of wet-lab science—BioBasicsBench.
Developed with Ligo, a biotech company focused on enzyme design, the benchmark draws on 100 tasks from real experiments to test whether agents can interpret raw lab data, identify errors, and recognize when the evidence doesn’t support a conclusion.
Accelerating biological research starts with getting the everyday work right. BioBasicsBench shows where models need to improve, and helps us track what those gains mean for scientific progress, biosafety, and biosecurity.
顯示更多