Register and share your invite link to earn from video plays and referrals.

Jasper Dekoninck
@j_dekoninck
PhD Student at ETH Zurich, working on mathematical evaluation of LLMs (MathArena, IMproofBench, BrokenMath, ...)
Joined June 2023
161 Following    4.6K Followers
In discussion with Fireworks, we investigated this in more depth. Rerunning DeepSeek through Fireworks now reproduces our results. We could not find any issues explaining the significantly worse performance in our original run (except for bad luck), but at most it seems to be a temporary fluke.
Show more