Personally, working on the S1 release with the team has been one of the most satisfying accomplishments of this year. I’ve spent countless late nights discussing some of my favorite topics—like affordances and how we can build systems that truly generalize. We’ve celebrated every step change in generalization: from new object arrangements, to different objects, to where we are today—being able to perform completely unseen tasks. When I started working in robotics, I never imagined we’d reach a point where a robot could perform a task it had never been trained on, simply through prompting.
And we’re proud to say that no other research group has yet demonstrated generalization to completely unseen tasks, or to long-horizon tasks like making pancakes.