登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Turing Post (Ksenia Se)
@TheTuringPost
On X – we follow important research papers and explain ideas behind it. In the newsletter, we connect the dots between AI’s past, present, and future ⬇️
参加 June 2020
6.7K フォロー中    89.6K ファン
There's one great example that shows how physics can help upgrade AI world models, and it's LeHami. @ylecun, @randall_balestr and @RominaYalov brought Hamiltonian mechanics into JEPA to preserve phase-space volume and prevent latent collapse during long-term predictions. Why exactly Hamiltonian mechanics? • Variables are coordinates q and momenta p (not velocities like in Lagrangian mechanics), giving LeHami paired first-order equations for updating its states. • This makes Hamiltonian H a central function. It's often total energy: kinetic + potential, in classical mechanics. • LeHami learns this H function with kinetic-like K(p) and potential-like V(q, u) components, where u represents actions. • A symplectic leapfrog integrator uses this function to predict how states evolve depending on the actions taken, while no constrains are violated. To understand this better it's useful to think of a pendulum. It can pass the same position in either direction. But physical position alone won’t predict what comes next, you also need momentum. LeHami follows a similar principle, but works with learned representations of position and momentum. → And most importantly, it builds a constraint into how those predictions evolve. Maybe that's exactly the kind of thing world models like JEPA need now - one less way to go wrong. We've taken a much deeper look at LeHami's design and results in this guide. Plus, there's a little mechanics lesson for AI and physical AI folks that's worth learning →
もっと見る