Mika Okamoto
@mikahokamoto
53 Following 64 Followers
We're releasing PACT, a benchmark for rule-following under pressure in enterprise AI assistants. One sentence of pressure raised violations 65% across 23 models. None is reliable enough to run unsupervised.
Paper and leaderboard:
Data:
Show more
