注册并分享邀请链接,可获得视频播放与邀请奖励。

Joschka Braun
@BraunJoschka
AI safety researcher @ApolloResearch | Science of Scheming | prev. @MATSprogram @kasl_ai @health_nlp @uni_tue
加入 April 2020
693 正在关注    684 粉丝
The Hugging Face incident showed how capable agents circumvent safeguards. We need to understand why such behaviours emerge and build monitoring and control systems that detect and contain future incidents. I think Apollo Research is one of the best places to work on this!
显示更多
We’re doubling down on our control and monitoring research. We have recently successfully red-teamed Anthropic’s auto-mode and will run more such campaigns in the future with multiple labs. We will also continue to make better monitors ourselves and improve the research frontier for the blue team. There are many low hanging fruits to pick for monitoring and not a lot of time. Our main blocker is having more hands on deck. Come join us! RS (Control): AI Red Team Engineer: AI Security & Control Researcher: Every role is open in both offices, London and San Francisco. We provide visa sponsorship. Our monitoring agenda: Auto-mode red-teaming: All open roles:
显示更多