가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Applied Compute
@appliedcompute
The best AI is built, not bought. Our platform, Applied Compute Agent Cloud, is now in private beta. Book a demo below.
가입 July 2012
24 팔로잉 중    8.3K 팬
Our reward hacking monitor is how our Applied Researchers, like @evandavidellis, catch models cheating during RL. This is calibrated on an internal benchmark of real reward hacks we've observed in our runs. Today, we're rolling out this monitor into AC2.
더 보기
We're adding reward-hacking monitors into AC2. Every RL run gets checked for cheating, and our research agent, Ari, automatically investigates the flags. After a model discovers an exploit, it can become its default strategy within a few training steps. We used to hunt for reward hacking manually, reading traces and running one-off agent queries. This was error prone and didn't scale. We decided to automate detection instead.
더 보기