Ying Liu(@liuying04):SWE-Bench Pro V2 has joined the Specialized Intelligence Index. @ScaleAILabs built SWE-Bench Pro v2 around challenging tasks from applications, business services, and developer tools. Our private commercial cases also help assess performance on codebases that aren’t publicly available. By joining the SII, we’re helping teams compare models against the demands of maintaining and extending software. These results give engineering teams a stronger basis for deciding which models to test on their own repositories.

Ying Liu

@liuying04

Sr Director of Research at @Scale_AI | agents research, RL environments, professional domain agents, AI for science | ex-Meta | ex-Google | Erdős number 3

Joined September 2013

703 Following 637 Followers

Ying Liu@liuying04

2026.10.28 16:47

SWE-Bench Pro V2 has joined the Specialized Intelligence Index. @ScaleAILabs built SWE-Bench Pro v2 around challenging tasks from applications, business services, and developer tools. Our private commercial cases also help assess performance on codebases that aren’t publicly available. By joining the SII, we’re helping teams compare models against the demands of maintaining and extending software. These results give engineering teams a stronger basis for deciding which models to test on their own repositories.