It's incredible seeing Anthropic commit to third-party evaluators.
However, we believe open weights takes this same idea further. Anyone can inspect, evaluate, and red-team the model.
We hope to see more open collaboration in building this powerful technology.
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: