EBench is here. An indoor VLA manipulation benchmark from InternRobotics for long-horizon, dexterous, and mobile manipulation in Isaac Sim. ๐
๐ค
๐ฏ Tasks: 26 evaluation tasks across long-horizon manipulation, simple pick-and-place, and teleop-style dexterous tasks
๐ข Dataset: LeRobot-format trajectories with multi-view videos from head, left hand, and right hand cameras
๐ ๏ธ Setup: client-server architecture keeps Isaac Sim on the server side while models connect through a lightweight client
๐ Assets: benchmark assets and dataset are released for reproducible embodied evaluation
๐ป License: MIT