I am seeing claims around LLMs, specifically Astra having made serious progress on robotics. The tasks that are demonstrated are simple pick and place tasks with parallel jaw grippers. LLMs can do planning, and the impressive demos in these tasks primarily show that. But robotics is also about dexterity and dynamics - which is why we need high frequency controllers/policies that can deal with torques and forces. So here is a simple challenge. Can you prompt an LLM to output the high frequency control commands for a legged robot in varying terrain e.g. RSS 2021, CoRL 2022 (this is by now 5 year old technology, so I am not picking a particularly hard task). I am not questioning the usefulness of LLMs for high level planning or in agentically assisting a robotics researcher (we use them all the time!).