From OSWorld 1.0 to 2.0, we went from minutes (~30 steps) to hours (~318), from single apps to real workflows, from high scores (83%) to hard problems (21%).
1+ year, 20+ people, every task rigorously verified. This is what real cua evaluation takes.🙏
👉