over the past week, I’ve gotten a lot of questions about what independent AI evaluations should actually look like in practice. what about conflicts of interest between labs and evaluators? will evaluators actually get meaningful access? what if companies just block the publication of unfavorable findings? these are good and important questions. and we shouldn’t assume voluntary arrangements alone will produce the conditions that credible independent evaluation requires. so i’m very excited to see 100+ researchers, evaluators, and experts — including us at @AVERIorg — laying out minimum conditions for embedded evaluation, including: meaningful independence, strong access, transparency / editorial control, protections against retaliation, and a diversity of perspectives and competencies. and we shouldn’t try to incorporate those principles in ad hoc, one-off agreements, policy is critical to standardizing these safeguards across the industry. glad to see @aievalforum leading on putting these principles on paper.