Joe Benton
@JoeJBenton
Soon joining @METR_Evals | Previously Alignment at Anthropic, PhD at University of Oxford
๊ฐ์
February 2017
63 ํ๋ก์ ์ค 13.1K ํฌ
๐ฐ Excited to share a pair of papers on AI Control doing red team/blue team evaluations in SHADE-Arena. We develop stronger safety protocols and stronger attack policies using synthetic data.
From @ChloeLough333 and @JKutasov's work during the Anthropic Fellows Program.
๋ ๋ณด๊ธฐ
Whatโs holding back good agent security protocols? Good sabotage agents. We find ways to improve sabotage agent performance to better test our security protocols.
