Register and share your invite link to earn from video plays and referrals.

Search results for ActionModels
ActionModels community
One keyword maps to one global community path.
Create community
People
Not Found
Tweets including ActionModels
Native Action-Prior Learning from Videos for World Action Models paper:
Do Vision-Language-Action models mean what they say? Embodied chain-of-thought offers a promising way to leverage additional inference-time computation for robot policies, with empirical evidence that it can improve downstream task performance. However, in practice the extent to which this chain-of-thought actually influences a robot policy’s chosen actions is not fully understood yet. In our new paper on #embodied# #reasoning#, we formally define the notion of faithfulness i.e., whether the chain-of-thought truthfully reflects the policy's decision for #Physical# #AI# and argue that the faithfulness of robot policies should play an explicit role in algorithm design. We train a critic of embodied faithfulness, identifying the signatures of inconsistent and incoherent reasoning, and use it as a reward signal during reinforcement learning (RL) post-training of a robot policy. We call our critic Pinocchio 🤥: a model that learns to tell when a robot policy is 'lying' about the justifications for a decision. Pinocchio scores two complementary failure modes: whether the reasoning is grounded in what the robot actually sees, and whether it is coherent step-to-step through the chain-of-thought. We find that post-training for faithfulness yields a +18% improvement in reasoning consistency over standard baselines, and critically, makes the policy 1.6× more responsive to rare, out-of-distribution scenarios that confuse SoTA models. These findings suggest that faithful embodied reasoning is not merely a post-hoc interpretability property, but an important ingredient for building more robust and trustworthy autonomous systems. 📄 Paper: 🌐 Project page: 💻 Code: Coming soon! Great work led by Matthew Foutter, in collaboration with Matteo Cercola Lena Wild Yunshan Wang Michelle Li and @DanieleGammelli @StanfordEng @StanfordAILab @StanfordHAI
Show more
A survey paper on World Action Models. WAMs are moving robotics from reacting to the present toward predicting consequences before acting. A model only counts as a WAM when its predicted future directly helps produce, score, verify, or train the action. The trend is “dream less, act more”: full video generation is often too slow and memory-heavy for real control loops. Many newer systems skip rendered video and use latent features, geometry, affordance maps, or motion representations instead. Photorealistic futures are not necessarily the most useful; flow, masks, tactile signals, and physically grounded latents may constrain action better. There is no single winning architecture because every design trades predictive richness against latency, memory, action-label cost, and physical reliability. The biggest open question is whether robots can spend heavy predictive compute only when uncertainty, contact, or irreversible error makes it necessary. – arxiv. org/abs/2606.20781 Title: "World Action Models: A Survey"
Show more
General world models could overtake specialized vision-language-action models around 2027. @1x_tech founder @BerntBornich made this specific prediction in his interview with @ti_morse Key highlights: 1. Data diversity is the constraint. More recordings of the same tasks add less than exposure to new environments, objects, and ways tasks fail. In Bernt’s words, robotics is “diversity bound.” 2. Internet video could do most of the training. Bernt expects it to provide roughly 99% of 1X’s training data. First-person human video, simulation, teleoperation, and robot experience would supply other kinds of examples. 3. The model should eventually collect its own training data. Bernt wants deployed robots to attempt unfamiliar tasks, record successes and failures, and improve through retraining without a human operating each attempt. 4. That gives the 50,000 target a second purpose. 1X aims to manufacture and ship 50,000 NEOs in 2027. A fleet that size could expose the model to far more variation, provided the robots meet the safety and quality bar for deployment. Interview:
Show more
I just published Web3 Growth Study Case: How @ActionModelAI Built 8,991 Verified AI Believers in One Campaign with @taskonxyz
“OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining” World–Action Models inherit dynamics priors from video models, but it was unclear how to convert them into effective control. This paper shows the real gain comes from coupling world prediction with action generation, and that large-scale embodied pretraining mainly improves OOD generalization rather than in-domain fitting.
Show more
social farming is cooked literally just bots engaging with bots at this point we linked with @ActionModelAI to kill the meta actionfi proves u actually used the product neosoul proves if your thesis was actually right verified actions mapping to real outcomes nothing else matters tbh drop ur take below are we getting a rate cut next month or is the fed bluffing
Show more
0
165
295
65
Forward to community
We're partnering with @DreamscaleLabs to evaluate frontier robotics models in the cloud. We explore running VLAs in parallel simulation, serving heavy World Action Models from the cloud, and real-time inference on physical robots.
Show more
NEW METHOD TO TRAIN ROBOTS: Physical Intelligence is at it again! Not so new actually, but worth mentioning because its impact is still going strong today. Called Real-Time Action Chunking (RTC), it is an inference-time method from Physical Intelligence @physical_int for running flow and diffusion-based vision-language-action models in real time. A few definitions: - Action chunk: a short block of future actions (say the next 50 motor commands) predicted in one shot instead of one step at a time. - Flow matching: a faster cousin of diffusion -> the model learns a straight-line path from noise to the target action trajectory, so it needs only a few integration steps instead of many denoising ones. - Diffusion: a generative method that starts from pure noise and iteratively denoises it into structured output. Here, the output is a trajectory of robot actions rather than an image. - Inpainting: the image-editing trick where a generative model fills in a masked region so it's consistent with the pixels around it. Diffusion and flow models can do this natively. RTC's insight is that a chunk of robot actions can be "inpainted" the same way: freeze the part already committed, generate the rest to match. - Inference-time method: a change to how the trained model is used, not how it's trained: no new data, no fine-tuning, no architecture change. - Closed-loop control: act, observe the result, correct, continuously. The opposite of executing a pre-planned motion blind. "Synchronous closed-loop at 10 Hz" means the robot would have to pause and wait for each new decision, which is exactly the stutter RTC removes. A chunked VLA predicts a block of future actions, then has to compute the next block while still executing the current one. Naively switching to the freshly computed chunk mid-motion results in disaster because the new actions conflict with the trajectory in progress, producing jerks and pauses that aren't in the training data. RTC frames the handoff as an inpainting problem: the actions that will execute before the next inference arrives are frozen to the previous chunk's values, and the model inpaints the remaining actions under partial attention, using the native inpainting ability of flow/diffusion samplers. It requires no training-time changes and runs on existing models (π0, π0.5, π0-FAST), demonstrated on match-striking, Ethernet-cable insertion and clothing folding. The whole method is a reframe: treat real-time control as inpainting. Diffusion and flow VLAs can already inpaint (fill masked outputs conditioned on known ones), so RTC just freezes the actions that will execute before the next inference lands and lets the model inpaint the rest without any training-time changes. That means any existing flow/diffusion VLA gets smooth async execution for free: no new data, no fine-tune, no architecture change. The latency problem is solved entirely at sampling time by borrowing a capability the models already had. Typical remote inference is 108ms (static) to 139ms (mobile) total, including 97ms of model inference. Roughly 100ms per decision is about 10Hz, far too slow for smooth synchronous closed-loop control, so a big VLA physically cannot "stop, think, act" without visible pauses. The evaluation metric is throughput: proportion of substeps completed successfully divided by duration, and the tasks are ones where a mistimed pause is catastrophic. Match-striking needs a continuous stroke, cable insertion needs steady precision, folding needs uninterrupted motion. PI chose tasks where discontinuity ruins the attempt, which is exactly where RTC's benefit is most visible. The metric rewards both success and speed at once.
Show more
FULL INTERVIEW: Brian Potter says robots learned kung fu before they learned to pick things up because motion is easy to train in simulation and grabbing objects isn't. The fix catching on now is putting "Hulk hands" with cameras on humans to record the data. @_brianpotter writes Construction Physics and is a senior infrastructure fellow at @IFP. He joined @theojaffee and @schisofrenia to break down how AI drives robots, why prefab houses still can't beat hand tools, and the rise and fall of the plasma screen: 00:56 the rise and fall of the plasma screen 04:40 how vision-language-action models drive robots 06:33 why data is the hardest part of robotics 07:46 GPT-6 Astra, and whether frontier models make robot models obsolete 09:51 teleoperation vs simulation 10:18 why robots can do kung fu but can't grab things 11:07 UMI, or giving humans Hulk hands 11:56 how to actually learn how things get built 16:47 why prefab houses still can't beat hand tools 18:12 if we can prefab chips, why not houses 19:07 why cheap robots could fix construction
Show more