Vals AI(@ValsAI):However, the largest improvement came in math. On ProofBench, our private benchmark of mathematical proofs, Muse Wonder Full (Max) solved 94 of 100 problems, compared with 58 for Muse Spark 1.3 Max. The 36-point jump brings Meta within 5 to 6 points of the top models, which score 99 to 100.

Vals AI

@ValsAI

Public LLM Evaluation // @8vc @BloombergBeta @pearvc @a16z @HRTVentures @nextladder

加入 March 2024

282 正在关注 30.4K 粉丝

Vals AI@ValsAI

2026.10.12 18:02

However, the largest improvement came in math. On ProofBench, our private benchmark of mathematical proofs, Muse Wonder Full (Max) solved 94 of 100 problems, compared with 58 for Muse Spark 1.3 Max. The 36-point jump brings Meta within 5 to 6 points of the top models, which score 99 to 100.

显示更多