Ying Liu(@liuying04):SWE-Bench Pro V2 has joined the Specialized Intelligence Index. @ScaleAILabs built SWE-Bench Pro v2 around challenging tasks from applications, business services, and developer tools. Our private commercial cases also help assess performance on codebases that aren’t publicly available. By joining the SII, we’re helping teams compare models against the demands of maintaining and extending software. These results give engineering teams a stronger basis for deciding which models to test on their own repositories.

2026.10.28 16:47

SWE-Bench Pro V2 has joined the Specialized Intelligence Index. @ScaleAILabs built SWE-Bench Pro v2 around challenging tasks from applications, business services, and developer tools. Our private commercial cases also help assess performance on codebases that aren’t publicly available. By joining the SII, we’re helping teams compare models against the demands of maintaining and extending software. These results give engineering teams a stronger basis for deciding which models to test on their own repositories.