Reilly Haskins(@ReillyHaskins02):We run lots of evals at METR. Sometimes, agents attempt harmful actions. I built a monitor that blocks suspicious tool calls until a human reviews them. Writing out a case for why it's effective surfaced hidden assumptions. I'd recommend it to anyone building monitors!

Reilly Haskins

@ReillyHaskins02

AI safety research @ METR

가입 August 2025

30 팔로잉 중 271 팬

Reilly Haskins@ReillyHaskins02

2026.09.28 21:30

We run lots of evals at METR. Sometimes, agents attempt harmful actions. I built a monitor that blocks suspicious tool calls until a human reviews them. Writing out a case for why it's effective surfaced hidden assumptions. I'd recommend it to anyone building monitors!