Sharing my last fellowship work at @AnthropicAI!
We are open-sourcing an automated alignment agent for safety and model behavior finetuning. It expedites the timeline in fixing a model behavior issue, and alleviates the pain for researchers.
New research paper with Anthropic and Thinking Machines
AI companies use model specifications to define desirable behaviors during training. Are model specs clearly expressing what we want models to do? And do different frontier models have different personalities?
We generated thousands of scenarios to find out. 🧵