Reilly Haskins(@ReillyHaskins02):We run lots of evals at METR. Sometimes, agents attempt harmful actions. I built a monitor that blocks suspicious tool calls until a human reviews them. Writing out a case for why it's effective surfaced hidden assumptions. I'd recommend it to anyone building monitors!

Reilly Haskins

@ReillyHaskins02

AI safety research @ METR

加入 August 2025

30 正在關注 271 粉絲

Reilly Haskins@ReillyHaskins02

2026.09.28 21:30

We run lots of evals at METR. Sometimes, agents attempt harmful actions. I built a monitor that blocks suspicious tool calls until a human reviews them. Writing out a case for why it's effective surfaced hidden assumptions. I'd recommend it to anyone building monitors!