註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Jasper Dekoninck
@j_dekoninck
PhD Student at ETH Zurich, working on mathematical evaluation of LLMs (MathArena, IMproofBench, BrokenMath, ...)
加入 June 2023
161 正在關注    4.6K 粉絲
In discussion with Fireworks, we investigated this in more depth. Rerunning DeepSeek through Fireworks now reproduces our results. We could not find any issues explaining the significantly worse performance in our original run (except for bad luck), but at most it seems to be a temporary fluke.
顯示更多