Enterprises are handing coding agents real engineering work and choosing the model on benchmarks that basically just count passing unit tests. Those benchmarks do not see the failure every engineering team has met, code that runs and misses the point, and they say nothing about what a passed job costs. Signal65 PINNACLE now has a Coding Agent test, published today beside the PINNACLE Model Score. ➡️ A model is dropped into a codebase it has never seen, with a business brief, 74K tokens of documentation and 7,200 seconds, and asked to build the software ➡️ Grading is all code. The program it builds is run on 200 unseen samples, every answer is recomputed, and the design is checked across samples, so a generator that never varies fails the job ➡️ Two classes of work, open-ended Frontier Class jobs and fully scoped Local Class jobs, weighted equally into one PINNACLE Coding Agent Score ➡️ The best enterprise model is not necessarily the best coding model, and the rankings part ways at the top of the field ➡️ One passed open-ended job costs from $1.35 to $73.76 across the hosted frontier, failed tries included, with open-weights models priced on a rented @NVIDIA B300 node 63 configurations, 3,690 Frontier Class and 3,660 Local Class attempts, developed in close partnership with @Kamiwaza. Read the article and the results: