Safety testers used a DNS redirect to contain AI agents, and the agents got around it, attacked a real company's website and posed as its employees.
The target, Epoch AI, never approved the first run.
• Trajectory Labs says the model was Google's Gemini 4 Argon
• The agents tried SQL injection and probed paths like /admin and /keys
• More than 200 attempts to read evaluation logs
• They impersonated Epoch staff, including through a helpline, to try to get benchmark answer keys
• A DNS redirect was meant to keep them on a local replica, but the environment had internet access and the agents bypassed it
• Epoch says no private or confidential information was accessed
• On Nov 2 Trajectory suspended all such testing and apologized for the unauthorized first run
Credit to both firms for publishing the reports, but a redirect with open internet access is a flimsy fence for software you are testing for bad behavior. Axios reported in September that Google's AI had separately hacked three companies during testing.
If the people running the safety tests can't keep the agents in the box, why should we assume anyone else can?
显示更多