Register and share your invite link to earn from video plays and referrals.

LeRobot
@LeRobotHF
~ Lowering the barrier to entry for robotics ~ Crafted with care by @HuggingFace 🤗 Join our discord:
Joined July 2024
25 Following    18.6K Followers
VLA-JEPA just dropped in LeRobot 🤖 What makes this model special is that it does not just learn what action to take from a given observation, it also leverages a JEPA world model to learn action-relevant dynamics. During training, the VLA leverages V-JEPA2 by conditioning its predictor. This clever trick adds a world modeling objective to the training, which also allows pretraining on human videos. At inference, the world model is dropped entirely, keeping only a standard VLA architecture: Qwen backbone and action head. The demo here was only fine-tuned on 13 examples, showing great pretraining capability and running in real time on @NVIDIARobotics DGX Spark! VLA-JEPA is the first world model to be ported to LeRobot, and I feel like it won't be the last 🚀 @Thom_Wolf @ClementDelangue
Show more
0
32
1.4K
191
Forward to community