登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

LeRobot
@LeRobotHF
~ Lowering the barrier to entry for robotics ~ Crafted with care by @HuggingFace 🤗 Join our discord:
参加 July 2024
25 フォロー中    18.6K ファン
VLA-JEPA just dropped in LeRobot 🤖 What makes this model special is that it does not just learn what action to take from a given observation, it also leverages a JEPA world model to learn action-relevant dynamics. During training, the VLA leverages V-JEPA2 by conditioning its predictor. This clever trick adds a world modeling objective to the training, which also allows pretraining on human videos. At inference, the world model is dropped entirely, keeping only a standard VLA architecture: Qwen backbone and action head. The demo here was only fine-tuned on 13 examples, showing great pretraining capability and running in real time on @NVIDIARobotics DGX Spark! VLA-JEPA is the first world model to be ported to LeRobot, and I feel like it won't be the last 🚀 @Thom_Wolf @ClementDelangue
もっと見る