注册并分享邀请链接,可获得视频播放与邀请奖励。

Fred Oliveira 🧠
@f
working towards better AI futures. AI safety at @snyksec. Organizing @lisbonai_. Data and capital at @capitalfactory. Prev: @gumroad @techcrunch @oreillymedia
加入 September 2006
922 正在关注    133.9K 粉丝
language being compression makes it so that agents can effectively pack lots of meaning into very brief pieces of text. This helps them coordinate more efficiently and makes our review of such coordination *much* harder. not only is the fraction of what we can monitor via CoT shrinking, we're also far worse at interpreting the tokens we do see.
显示更多
For (1), agents modified their target programs to be easier to exploit & put the modified targets in cache. They then worked on crashing their targets in the hope that a restart would load the modified version from cache. Some agents risked failing their task to try this.
显示更多