Register and share your invite link to earn from video plays and referrals.

Yoshi | WorldFlux
@yoshi_flux
Founder @ WorldFlux. Building tools to reproduce Open-RMF failures & verify fixes in simulation. Seeking design partners. @fdotinc Canopy alum.
Joined November 2020
698 Following    372 Followers
Robots won't learn to act from robot demos. They'll learn from video games. Takeaways from @PimDeWitte's @aiDotEngineer talk on @gen_intuition (spun out of @Medal_TV): - LLMs are turn-based. The real world isn't. GI's models take in frames and output actions continuously, in real time. - Many robots already run on gamepads. So games and robots share the same action space. No need to predict motor torques. - Medal sees 1.5T+ action tokens a month. Pim says that's more in half a day than frontier labs use in total for robotics. - Gamers are action-dense. High APM data beats sparse teleop for fine control. - Result, per Pim: one model plays games at a top level and controls 10+ robot types. Pixels in, actions out. - The moat is real action labels. You can't infer a pilot's rudder input from video. Anthropic bet on code. GI is betting on pixels.
Show more