注册并分享邀请链接,可获得视频播放与邀请奖励。

Jasper Dekoninck
@j_dekoninck
PhD Student at ETH Zurich, working on mathematical evaluation of LLMs (MathArena, IMproofBench, BrokenMath, ...)
加入 June 2023
161 正在关注    4.6K 粉丝
In discussion with Fireworks, we investigated this in more depth. Rerunning DeepSeek through Fireworks now reproduces our results. We could not find any issues explaining the significantly worse performance in our original run (except for bad luck), but at most it seems to be a temporary fluke.
显示更多