In Cybersecurity, unmeasurable capability is unshippable capability. @Gabeincognito and I discuss what it takes to measure real agentic performance and why a correct verdict for the wrong reasons is still a failure.
A 95% match rate between an AI agent's verdict and an analyst's can still mask pattern-matching behavior. Carter Church & Gabriel Bernadett-Shapiro explain why SentinelOne builds security agents backwards from evaluation, testing competency by competency to confirm real investigative reasoning: