註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Jasper Dekoninck
@j_dekoninck
PhD Student at ETH Zurich, working on mathematical evaluation of LLMs (MathArena, IMproofBench, BrokenMath, ...)
加入 June 2023
161 正在關注    4.6K 粉絲
Trying to run Opus-5.5 on MathArena and getting repeatedly hit with "reasoning_extraction" refusals... for math questions. The model reasons for 128k tokens, gets output token limit, and when I continue the request, it just refuses. Guess we are also running that one at high...
顯示更多