“Earlier this week, we talked with Miles Brundage, the executive director of the AI auditing think tank AVERI. We were discussing the various ways that AI regulation could resemble (at least on its surface) financial regulation. So for example, you could have entities like Fitch that literally assign a rating to a model. But you could also theoretically imagine the equivalent of bank examiners, who are really involved in the operations of the company itself to establish that they're really engaging in ongoing safe behaviors. Setting aside what Anthropic does, I do wonder whether we could hit some kind of inflection point, where the pace of AI progress shifts into a lower gear due to this mismatch between model capabilities and the testing capabilities. It's possible that further safe development will require significantly more investment not in the classical inputs (data, electricity, and other things that just make the line go up) but in environmental maintenance, which might not automatically translate into capability gains.”