Register and share your invite link to earn from video plays and referrals.

Yarchi
@undefinedKi
AI & tech researcher | Data engineer | Building cool stuff | Sharing everything I learn
Joined March 2015
519 Following    20.7K Followers
Absolutely incredible. AI just took its first real science exam. Claude Opus 5 scored 90.9% on scientific coding. Open-weight DeepSeek-V4.1-Flash beat GPT-6.1 and Claude at hypothesis discovery, 21.3% vs 4.9% and 7.3%. Science's Last Exam: 50+ real research tasks across 9 disciplines, checked by hidden tests the agent never saw. This is a big moment for all of AI research.
Show more
I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ 🌐 💻 🤗 Thread below on how the exam works and where models break. 👇 (1/14) #AGI# #AIforScience# #AIAgents# #SciencesLastExam# #OpenAI# #Anthropic#
Show more