가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Jasper Dekoninck
@j_dekoninck
PhD Student at ETH Zurich, working on mathematical evaluation of LLMs (MathArena, IMproofBench, BrokenMath, ...)
가입 June 2023
161 팔로잉 중    4.6K 팬
In discussion with Fireworks, we investigated this in more depth. Rerunning DeepSeek through Fireworks now reproduces our results. We could not find any issues explaining the significantly worse performance in our original run (except for bad luck), but at most it seems to be a temporary fluke.
더 보기