Really important piece to read. It seems obvious that every company is going to have to create private benchmarks for tasks and there's going to be some platform that allows companies to create those benchmarks. Right now everyone's business is a fleet of vehicles (workflows) going to the gas station to get gas (model), but no one has the label on the side of their door saying whether they need unleaded, premium, or supreme. So they unnecessarily use premium. And the only information they have on what gas to use are generic standards (arena ai, SWEbench) saying all SUVs should use premium, all pick up trucks should use diesel, etc. Prob 12-18 months out from this having a huge market because most enterprises are earlier in their AI journey then necessitates this precision, but feels like the right time to get started solving this problem.