A robot may know how to move yet still need evidence about what to do. This 100+ page survey organizes the research on supplying that context.
Title: In-Context Learning for Robots: Methods and Applications
URL:
❓ What is in-context learning for robots?
It's adaptation that uses demonstrations and interaction to direct existing competence, with neural parameters held fixed at deployment. Broad pretraining gives a robot reusable motor skill, but the current scene can still leave several procedures feasible, hide an earlier event, or say nothing about how an unfamiliar material responds. More motor competence alone never closes that gap.
❓ How is it different from fine-tuning?
Fine-tuning folds new evidence into the weights; in-context learning makes it available at the decision instead. The survey separates five places adaptation can live: supplied context, recurrent state, external memory, test-time weight updates, and persistent weight updates. The first three are the parameter-fixed regime.
❓ How are the methods organized?
Into four families, split by the intermediate that execution actually consumes.
・Context-conditioned policies (infer actions straight from the evidence)
・Geometric demonstration transfer (align a reference motion, then track it)
・World-model-based control (predict futures, then plan)
・Skill- and agent-based execution (pick skills or programs for a separate executor)
The key point is that one demonstration can feed any of the four; what separates them is the intermediate execution needs, not how the evidence was gathered.
❓ How should this be evaluated?
By intervening under matched execution conditions: remove the supplied evidence, clear the memory, suppress retrieval, restore pre-adaptation weights. One reported comparison shows how hard the open end is: asked to discover an unfamiliar action convention unaided, the system succeeded in 1 of 20 episodes and got only 23.3% of the mappings right.
#
Robotics# #
InContextLearning#