登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Yarchi
@undefinedKi
AI & tech researcher | Data engineer | Building cool stuff | Sharing everything I learn
参加 March 2015
519 フォロー中    20.7K ファン
Absolutely incredible. AI just took its first real science exam. Claude Opus 5 scored 90.9% on scientific coding. Open-weight DeepSeek-V4.1-Flash beat GPT-6.1 and Claude at hypothesis discovery, 21.3% vs 4.9% and 7.3%. Science's Last Exam: 50+ real research tasks across 9 disciplines, checked by hidden tests the agent never saw. This is a big moment for all of AI research.
もっと見る
I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ 🌐 💻 🤗 Thread below on how the exam works and where models break. 👇 (1/14) #AGI# #AIforScience# #AIAgents# #SciencesLastExam# #OpenAI# #Anthropic#
もっと見る