Ivan Fioravanti
@ivanfioravanti
GenAI/LLM addicted, Apple MLX, Cloud computing, Kubernetes, Technology Advisor, Investor and Co-Founder & Board Member of CoreView.
Local AI Ambassador.
Joined June 2009
1.6K Following 43.1K Followers
RecreationBench looks really interesting! 🧐
Qwen introduces RecreationBench, a benchmark for Hybrid Computer-Use Agents with 250 application-recreation tasks across Ubuntu, macOS, Windows, Android, and Web, spanning domains such as productivity, development, graphics, multimedia, and science.
Unlike GUI-only or terminal-only benchmarks, agents must explore a running reference app, recreate it in code, and pass both programmatic tests and VLM-based visual evaluation.
The playground is ready. Let’s build!
🚀Dataset:
Show more
