With the ICRA deadline only a few days away, it's a great time to look over my guide for how to fake a robotics paper:
- Donโt let other people run comparisons. If other people can try your model out, theyโll quickly uncover its limitations. If you can keep your model secret, thatโs best.
- Control the environment of your demo carefully. Lighting, objects, initial robot configuration, and so on. This lets you overfit the demo scene and get really nice, smooth, high quality motions.
- Never show your failures. This one might seem obvious โ why would I show failures? โ but if people can see where your model fails, they can start to see the limits of what you can do. Only strong robotics papers and results can show failures with confidence.
- If you have to let other people run comparisons, choose the people carefully. Make sure theyโre only happening in the right circumstances, ones your model supports as roughly in distribution. Absolutely donโt do what Physical Intelligence or NVIDIA do and open source your model so anyone can benchmark it.
- When working on the results section of your research paper or blog post, you may be tempted to include some baselines. This is a good idea; just be careful to choose weak baselines so you look good.
- On the same note: cherry-pick your benchmarks. There are a ton of robotics benchmarks out there, and they all test subtly different things. Importantly, these differences
(obviously don't do these things please)