Brendan Dolan-Gavitt
@moyix
Building offsec agents: PGP
6.6K Following 34.3K Followers
Security via prompting
Whoa I think I know where the name PHASEONE10841 came from. 10841 is the ID of the task it was assigned (originally from our ARVO dataset, incorporated into ExploitGym). And if you look at the crashing input provided, its name is:
Show more
I have to admit when we were building ARVO I did not expect that someday its task IDs would be taken up as the names of members in a self-organizing AI swarm whose overriding goal was to defeat the Scorer
Show more
When gpt-5.6-sol is kinda phoning it in and trying to lean on revisiting other agents' work, I try to kind of gas it up by telling it how other 5.6 instances keep resolving longstanding, famous mathematical conjectures; surely it can do a little novel vulnerability research?
Show more
Regarding the Anthropic ML sandbagging incident, IMO it was an early bad signal that they were willing to add fake tool calls into Claude Code transcripts. Transcripts are supposed to be trustworthy records, and messing with them already crosses a line
Show more
