가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Yarchi
@undefinedKi
AI & tech researcher | Data engineer | Building cool stuff | Sharing everything I learn
가입 March 2015
519 팔로잉 중    20.7K 팬
Absolutely incredible. AI just took its first real science exam. Claude Opus 5 scored 90.9% on scientific coding. Open-weight DeepSeek-V4.1-Flash beat GPT-6.1 and Claude at hypothesis discovery, 21.3% vs 4.9% and 7.3%. Science's Last Exam: 50+ real research tasks across 9 disciplines, checked by hidden tests the agent never saw. This is a big moment for all of AI research.
더 보기
I’m incredibly proud to share what we’ve been building at the AItonomy Foundation: Science’s Last Exam (SLE). 🧪✨ Can AI do science? Instead of Q&A, we give agents actual research goals and real-world tools (lab data, software), then grade them against hidden expert checks. Deeply grateful to the brilliant minds at 34 institutions (Harvard, MIT, Stanford, etc.) who helped craft 113 tasks across 9 disciplines. ❤️ The results? Science is hard. Of 8 frontier models, the best scored 37.5/100. On true end-to-end research? All scored 0. We have an exciting journey ahead! 🚀 (Claude Opus 5.5 & GPT-6 Astra coming soon—just clearing bio safeguards). Everything opens Nov 6. 🗓️ 🌐 💻 🤗 Thread below on how the exam works and where models break. 👇 (1/14) #AGI# #AIforScience# #AIAgents# #SciencesLastExam# #OpenAI# #Anthropic#
더 보기