가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Jasper Dekoninck
@j_dekoninck
PhD Student at ETH Zurich, working on mathematical evaluation of LLMs (MathArena, IMproofBench, BrokenMath, ...)
가입 June 2023
161 팔로잉 중    4.6K 팬
Trying to run Opus-5.5 on MathArena and getting repeatedly hit with "reasoning_extraction" refusals... for math questions. The model reasons for 128k tokens, gets output token limit, and when I continue the request, it just refuses. Guess we are also running that one at high...
더 보기