๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

LeRobot
@LeRobotHF
~ Lowering the barrier to entry for robotics ~ Crafted with care by @HuggingFace ๐Ÿค— Join our discord:
๊ฐ€์ž… July 2024
25 ํŒ”๋กœ์ž‰ ์ค‘    18.6K ํŒฌ
VLA-JEPA just dropped in LeRobot ๐Ÿค– What makes this model special is that it does not just learn what action to take from a given observation, it also leverages a JEPA world model to learn action-relevant dynamics. During training, the VLA leverages V-JEPA2 by conditioning its predictor. This clever trick adds a world modeling objective to the training, which also allows pretraining on human videos. At inference, the world model is dropped entirely, keeping only a standard VLA architecture: Qwen backbone and action head. The demo here was only fine-tuned on 13 examples, showing great pretraining capability and running in real time on @NVIDIARobotics DGX Spark! VLA-JEPA is the first world model to be ported to LeRobot, and I feel like it won't be the last ๐Ÿš€ @Thom_Wolf @ClementDelangue
๋” ๋ณด๊ธฐ