February: no frontier model could solve Irregular's hardest exploitation task.
By April: the best one could, occasionally, for ~$2,000.
By June: several could, reliably, for ~$20.
Over the next year, we will likely enter a period where AI's offensive capability outpaces defense at scale.
@dan_lahav and the
@Irregular team are truly at the frontier of AI security, as major partners to the frontier labs.
This is the most detailed and thoughtful account of where AI security is today, where it's headed, and what we can do now so defenders don't fall behind.