I used to dream of times like this. I have been truly humbled by this news, but I think there's no better time to share that Evaluation Cards has been accepted as a Spotlight to @NeurIPSConf 2026!!!! Leading this project with @AnkaReuel, Jenny Chim, and Wm. Matthew Kennedy, alongside the most incredible team of researchers in the @evaluatingevals coalition, has been the honor of a lifetime. This project has been ongoing in some shape or form for the last 2 years (you can probably tell from the 95 page pdf), and the paper is just one milestone! Evaluation Cards is planned as a living documentation standard that will grow through open collaboration, responding to the evolving needs of research and technical AI governance stakeholders, and we aim to unify and standardize the fragmented field of eval reporting through a durable mechanism. It has been a joy to see this open standard start to be adopted by different stakeholders - meaning people in policy, in evals research, and in model development, in its early stages, and we are not done by any means! Many, many more cool things are coming out from this team soon! Come hang out on our Slack if you want to build cool eval research in the open, and we will see you at Neurips!! (On a personal note, this is also my first first-author paper to be accepted to NeurIPS, so I am just floored ♥️. Sincerely, THANK YOU to the people who donate their volunteer time to make EvalEval happen every single day.) Paper:

New @evaluatingevals blog: “Mapping Evaluation Cards to Emerging AI Governance Requirements in California, the EU, and the UK”, with @davidmanheim, @Andrxwtran, @Sree_Harsha_N, Jessica Ji, @batznerjan, Wm. Matthew Kennedy, @AnkaReuel, and @IreneSolaiman. Many recent AI governance proposals rely on evaluations, independent auditors, and external verification. But one very practical problem keeps coming up: once an evaluation has actually been run, how should the evidence be recorded and communicated in a way that regulators, evaluators, and developers can all use? Right now, oversight bodies often have to work through provider documentation in many different formats, making it much harder to compare evaluations or automatically parse the information they need. In this work, we took 40 governance requirements across California (AB 1405, SB 813), the EU (AI Act, GPAI Code of Practice), and the UK (JCHR Report), broke them down into 281 individual pieces of evidence, and then asked which of those actually belong in an evaluation record. We identified 60 such pieces, covering topics such as evaluation methodology, configuration, benchmark information, results, and the conditions under which an evaluation was conducted. We find that Evaluation Cards, through a mix of reported and auto-pulled fields, can already represent 56 of those 60 evidence elements! I think the broader opportunity here is that Evaluation Cards can provide a shared, open format for communicating evaluation evidence across developers, evaluators, and policymakers. Instead of every governance process asking for similar information in a different format, a common reporting layer can make that evidence easier to compare, reuse, and analyze. Evaluation Cards are also only one part of a broader ecosystem around AI evaluation and independent assessment. Other standards cover topics such as evaluator independence, model documentation, and incident reporting. The goal is for these pieces to work together, with each capturing the information it is best suited for while making the underlying evidence interoperable across different governance processes. We are already starting to put this into practice through our collaboration with the UK AI Security Institute (with more in the pipeline), and I think there is a real opportunity for evaluation infrastructure and governance requirements to shape each other. Policymakers can help expose where our schemas are incomplete and push them to better reflect global needs, while open schemas can give regulators a much clearer picture of what standardized, machine-readable evaluation evidence can actually look like. Would love feedback from people working on evaluations, auditing, regulation, or assurance. There is a lot more to build here :) Read the blog and explore the interactive map:

So we actually built this! Paper: Demo: We are actually looking for an org to run this fulltime as researchers in their individual capacity don't have bandwidth. If you are an independent org interested in maintaining a registry of flaw/incident reports and follow up with model providers pls reach out!