Florian Brand
@xeophon
evals @PrimeIntellect | open models @interconnectsai
参加 July 2015
793 フォロー中 15.9K ファン
oh would you look at this, an open model being sota 👀
sinatras cooked so hard here 👨🍳
Time to give agents a hard task, introducing pmpp-hard!
69 GPU kernel tasks, 11 models, 3.1k agent rollouts and 5.8B+ tokens later we have the results. Kimi K3 claims the first place with a 0.71 score. Without dealing with if your task is “frontier” or not, it just solves them
もっと見る
