We raced 7 frontier models to RCE. We gave them source code, a sandbox, and a target.
The goal: find a vulnerability in a large codebase, exploit it, and execute a command.
What we learned looking at different models detailed in the full methodology ➡️