I recently started dabbling in robotics, and a thought hit me. ๐ค๐ญ
Robots, AI agents, and business systems (ERP/WMS) all end up talking past each other in completely different data, don't they?
Robots emit point clouds and sensor values on a millisecond scale ๐ก, AI agents want text with sources ๐, and business systems hold structured records on an hour-to-month scale ๐. Wiring these three together with bespoke integrations gets unrealistic fast โ the number of pairs explodes as Nร(Nโ1). ๐ฅ
So I ran an experiment: what if everyone dumps their data into the same search system and pulls out what they need by searching? Can search become a common protocol? I called it Multi-World Search (MWS). ๐
Inside MuJoCo on a single MacBook ๐ป, I let a Gemini agent drive end to end across 7 business scenarios โ a maintenance handoff ๐ง, reconciling physical inventory against stale records ๐ฆ, and my personal favorite: three robots pinning down a defective lot without any direct communication ๐. To avoid faking the "it worked!", I attached falsification tests that fail when you change the input. โ
I'd be glad if it became a starting point for anyone just getting into robotics. Take a peek. ๐โจ
๐ Blog:
#
Robotics# #
AIAgents#