๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Marco Pavone
@drmapavone
Prof @Stanford, Distinguished Research Scientist and AV research lead @nvidia. PhD from @MITAeroAstro. Robotics, autonomous systems, AI. Opinions are my own.
๊ฐ€์ž… November 2018
76 ํŒ”๋กœ์ž‰ ์ค‘    7.3K ํŒฌ
Introducing TacitVLA โ€” the benefits of reasoning, without the latency! There is now conclusive evidence that #reasoning# supervision can improve the performance of Vision-Language-Action (VLA) models. More broadly, reasoning is a promising tool for building more capable and safer autonomy stacks. But generating a chain of thought token by token adds latencyโ€”a major bottleneck for real-time robotics and autonomous driving. TacitVLA introduces a training approach that captures the benefits of reasoning without requiring actions to wait for it. The key insight: reasoning traces improve the modelโ€™s backbone representations during training, allowing actions to benefit from this supervision without waiting for or conditioning on generated reasoning at inference time. For long-horizon tasks, reasoning traces can serve as episodic memory, generated asynchronously during action execution without adding latency when generation finishes within the execution window. ๐Ÿ“ˆ Across four manipulation and autonomous-driving benchmarks, TacitVLA matches the performance of its explicit-reasoning counterpart at up to 3.4ร— lower latency and achieves up to 17.1 percentage points higher success than the same architecture trained without reasoning, at comparable latency. ๐ŸŒ Project page: ๐Ÿ“„ Paper: This work was led by @Jacklu_me, in collaboration with @YurongYou @Boyiliee @yulong_c @tianran_ @ChaoweiX Xiangyu Chen, Wenjie Luo, @iamborisi @yan_wang_9 . @NVIDIAAI @NVIDIADRIVE @NVIDIARobotics #Robotics# #PhysicalAI# #EmbodiedAI# #Reasoning#
๋” ๋ณด๊ธฐ