Ivan Fioravanti
@ivanfioravanti
GenAI/LLM addicted, Apple MLX, Cloud computing, Kubernetes, Technology Advisor, Investor and Co-Founder & Board Member of CoreView.
Local AI Ambassador.
加入 June 2009
1.6K 正在關注 43.1K 粉絲
RecreationBench looks really interesting! 🧐
Qwen introduces RecreationBench, a benchmark for Hybrid Computer-Use Agents with 250 application-recreation tasks across Ubuntu, macOS, Windows, Android, and Web, spanning domains such as productivity, development, graphics, multimedia, and science.
Unlike GUI-only or terminal-only benchmarks, agents must explore a running reference app, recreate it in code, and pass both programmatic tests and VLM-based visual evaluation.
The playground is ready. Let’s build!
🚀Dataset:
顯示更多
