ModelScope(@ModelScope2022):Qwen introduces RecreationBench, a benchmark for Hybrid Computer-Use Agents with 250 application-recreation tasks across Ubuntu, macOS, Windows, Android, and Web, spanning domains such as productivity, development, graphics, multimedia, and science. Unlike GUI-only or terminal-only benchmarks, agents must explore a running reference app, recreate it in code, and pass both programmatic tests and VLM-based visual evaluation. The playground is ready. Let’s build! 🚀Dataset:

ModelScope

@ModelScope2022

Driving innovations with open communities. 💬 Join our Discord:

Joined April 2024

183 Following 16K Followers

ModelScope@ModelScope2022

2026.09.21 06:14

Qwen introduces RecreationBench, a benchmark for Hybrid Computer-Use Agents with 250 application-recreation tasks across Ubuntu, macOS, Windows, Android, and Web, spanning domains such as productivity, development, graphics, multimedia, and science. Unlike GUI-only or terminal-only benchmarks, agents must explore a running reference app, recreate it in code, and pass both programmatic tests and VLM-based visual evaluation. The playground is ready. Let’s build! 🚀Dataset: