Semgrep(@semgrep):We benchmarked Mythos against other models we have. Our analysis runs 23 configurations evaluated against 275 human-reviewed IDOR labels. Mythos did not take the top spot, and as others have reported the harness matters more than the model. See our results:

Semgrep

@semgrep

Code security for builders. Catch, flag, and fix real issues before they ship, powered by security that learns as you build.

Joined May 2019

205 Following 4.7K Followers

Semgrep@semgrep

2026.08.25 21:31

We benchmarked Mythos against other models we have. Our analysis runs 23 configurations evaluated against 275 human-reviewed IDOR labels. Mythos did not take the top spot, and as others have reported the harness matters more than the model. See our results: