In-Context Learning Results Hint at a “GPT Moment” for Robotics
For general-purpose robots to be useful and economical, you need to be able to teach them new skills on the fly. And now we can see how this will work, with in-context long horizon video demonstrations shown by companies like Generalist, Skild, Rhoda, Rhoda, and RobbyAnt.
The idea is simple: prompt with a demonstration, mixed video and proprioception information. Language isn't enough -- it doesn't specify the problem well enough. And it's starting to really work.
more in blog post