Qualia is now scoring very high on three important public robot-data benchmarks, scored exactly the way NVIDIA scores them. (Our setup reproduces NVIDIA’s numbers for GPT-6 Astra and Flora within about a point. Side note flora is surprisingly good)
Cutting robot video into steps, describing them, ranking recordings, judging how far a robot got: Qualia is ahead of Flora and GPT-6 Astra on every one.
We are just getting started, and expect Qualia to improve a lot more in the coming days. and weeks.
Hope to get more of you to try this soon.