Eric Ho
@eric_ho
co-founder / ceo @GoodfireAI - AI interpretability research company
加入 September 2011
581 正在关注 5.2K 粉丝
activation monitoring is faster, cheaper, and more effective than just running external monitors
one advantage is that activation monitors can run synchronously for almost no additional overhead because they can reuse the computations of the model
显示更多
On Kimi K3, our probes cut the cost of LLM monitoring by 90% with a ~1% drop in precision - making monitoring feasible at scale.
Reliably detecting reward hacking could let us stop hacks in progress, identify broken environments, discover new failure modes, and fix training.
显示更多
