Vals AI
@ValsAI
가입 March 2024
277 팔로잉 중 23.1K 팬
SWE-bench Verified, an older benchmark, is easy to shortcut with simple Git queries. The attempt rates were an order of magnitude higher: GPT-5.6 Terra at 89.4% and GPT-5.6 Luna at 78.8%, with a long tail of models pulling the same trick.
더 보기
