Practically what will come out of this essay is that frontier labs will all get some external auditors such as METR with more stringent release requirements.
It's unclear how effective this will be as the real world has a drastically different distribution than internal envs!
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: