Ivan Fioravanti
@ivanfioravanti
GenAI/LLM addicted, Apple MLX, Cloud computing, Kubernetes, Technology Advisor, Investor and Co-Founder & Board Member of CoreView.
Local AI Ambassador.
๊ฐ์
June 2009
1.6K ํ๋ก์ ์ค 43.1K ํฌ
RecreationBench looks really interesting! ๐ง
Qwen introduces RecreationBench, a benchmark for Hybrid Computer-Use Agents with 250 application-recreation tasks across Ubuntu, macOS, Windows, Android, and Web, spanning domains such as productivity, development, graphics, multimedia, and science.
Unlike GUI-only or terminal-only benchmarks, agents must explore a running reference app, recreate it in code, and pass both programmatic tests and VLM-based visual evaluation.
The playground is ready. Letโs build!
๐Dataset:
๋ ๋ณด๊ธฐ
