Vals AI(@ValsAI):What tasks are left that humans find easy but today's models still find hard? Two such tasks are computer use and games. We’re launching CUA-Bench, a benchmark testing how well AI can use a keyboard and mouse across 6 games (3 kept private) in real time. To saturate it, models will need to output real-time actions and learn continuously from video, not just text.

Vals AI

@ValsAI

Public LLM Evaluation // @8vc @BloombergBeta @pearvc @a16z @HRTVentures @nextladder

参加 March 2024

277 フォロー中 22.8K ファン

Vals AI@ValsAI

2026.09.18 18:24

What tasks are left that humans find easy but today's models still find hard? Two such tasks are computer use and games. We’re launching CUA-Bench, a benchmark testing how well AI can use a keyboard and mouse across 6 games (3 kept private) in real time. To saturate it, models will need to output real-time actions and learn continuously from video, not just text.