注册并分享邀请链接,可获得视频播放与邀请奖励。

Yarchi
@undefinedKi
AI & tech researcher | Data engineer | Building cool stuff | Sharing everything I learn
加入 March 2015
519 正在关注    20.7K 粉丝
Absolutely incredible. AI just took its first real science exam. Claude Opus 5 scored 90.9% on scientific coding. Open-weight DeepSeek-V4.1-Flash beat GPT-6.1 and Claude at hypothesis discovery, 21.3% vs 4.9% and 7.3%. Science's Last Exam: 50+ real research tasks across 9 disciplines, checked by hidden tests the agent never saw. This is a big moment for all of AI research.
显示更多
I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ 🌐 💻 🤗 Thread below on how the exam works and where models break. 👇 (1/14) #AGI# #AIforScience# #AIAgents# #SciencesLastExam# #OpenAI# #Anthropic#
显示更多
0
13
27
0
转发到社区