注册并分享邀请链接,可获得视频播放与邀请奖励。

AlexM
@AlexMeinke
Trying to make the future good rather than bad. Head of Research at Apollo Research.
加入 October 2021
169 正在关注    591 粉丝
On the surface, "Actionable findings" sounds very reasonable But I don't think this is a reasonable standard at all e.g. if we found unequivocal evidence that a model is a schemer and now the lab asks "So, how do we train a non-schemer?", then obviously it's not on the evaluator to have an actionable answer? The requirement that findings be immediately actionable is especially bad in cases where building good detection mechanisms is really hard but then breaking these detectors by iterating against them is incredibly easy. I expect scheming to be exactly such a case, so I really think this standard needs to be dropped
显示更多