I wonder if we're going to see an explosion in IRL RL envs in the near future, where models train on robotics harnesses connected to the real world and someone has to physically reset things in between rollouts
Are robots ready to accelerate science labs?
We created the WetLabs Benchmark to test 9 critical tasks, from easy to hard, and let 3 leading models take 20 attempts per task
Astra leads but it comes close...