Eric Ho
@eric_ho
co-founder / ceo @GoodfireAI - AI interpretability research company
加入 September 2011
581 正在关注 5.2K 粉丝
embedded evaluations are a great idea, and the team at @GoodfireAI would love to help with white box evaluations
the goal of white box evaluations could be to predict future misaligned behavior directly from the internal mechanisms of models, as well as stress test activation monitors
显示更多
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here:
显示更多
