I don’t think people realize just how bottlenecked we are on collective progress because of evals.
There are not enough good evals.
Introducing Benchmark Reviews: our new initiative to audit AI benchmarks. We are launching with 15 benchmarks: 4 Verified, 9 Flawed, and 2 with not enough information for a review.
Show more
