Florian Brand
@xeophon
evals @PrimeIntellect | open models @interconnectsai
加入 July 2015
793 正在關注 15.9K 粉絲
oh would you look at this, an open model being sota 👀
sinatras cooked so hard here 👨🍳
Time to give agents a hard task, introducing pmpp-hard!
69 GPU kernel tasks, 11 models, 3.1k agent rollouts and 5.8B+ tokens later we have the results. Kimi K3 claims the first place with a 0.71 score. Without dealing with if your task is “frontier” or not, it just solves them
顯示更多
