註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Yarchi
@undefinedKi
AI & tech researcher | Data engineer | Building cool stuff | Sharing everything I learn
加入 March 2015
519 正在關注    20.7K 粉絲
Absolutely incredible. AI just took its first real science exam. Claude Opus 5 scored 90.9% on scientific coding. Open-weight DeepSeek-V4.1-Flash beat GPT-6.1 and Claude at hypothesis discovery, 21.3% vs 4.9% and 7.3%. Science's Last Exam: 50+ real research tasks across 9 disciplines, checked by hidden tests the agent never saw. This is a big moment for all of AI research.
顯示更多
I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ 🌐 💻 🤗 Thread below on how the exam works and where models break. 👇 (1/14) #AGI# #AIforScience# #AIAgents# #SciencesLastExam# #OpenAI# #Anthropic#
顯示更多
0
13
27
0
轉發到社區