註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Evan Ellis
@evandavidellis
Research @ Applied Compute | BAIR | Scale | Imbue
加入 August 2021
814 正在關注    318 粉絲
We're adding reward-hacking monitors into AC2. Every RL run gets checked for cheating, and our research agent, Ari, automatically investigates the flags. After a model discovers an exploit, it can become its default strategy within a few training steps. We used to hunt for reward hacking manually, reading traces and running one-off agent queries. This was error prone and didn't scale. We decided to automate detection instead.
顯示更多