가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Marco Pavone
@drmapavone
Prof @Stanford, Distinguished Research Scientist and AV research lead @nvidia. PhD from @MITAeroAstro. Robotics, autonomous systems, AI. Opinions are my own.
가입 November 2018
76 팔로잉 중    7.3K 팬
Can we steer a robot foundation model without retraining it? Our new paper explores this question through control-inspired notions of feature observability and controllability in Vision-Language-Action (VLA) models. We find that state- and action-relevant information can often be linearly predicted from VLA internal representations—and that these representations can be steered at inference time to change robot behavior, without fine-tuning. As an example, on a real robot, our approach increased the preferred handle-grasp rate from 14% to 74%, while adding only ~1% inference-time overhead. The broader idea is that representation-level control could provide a lightweight interface for adapting robot foundation models to new preferences and constraints—without retraining. Joint work with Hugo Buurmeijer Carmen Amo Alonso @SwannAiden Paper: #PhysicalAI# #Robotics# #VLA# #RobotLearning# @StanfordEng @StanfordAILab
더 보기