A core thesis behind Claims is that an open competition will create better results than any in-house process.
Our production data is already validating that thesis - in less than 4 weeks!
Our measure of data quality is the % of miner-submitted claim-evidence pairs for a given paper that:
(1) deviate from our own pipeline and
(2) were unanimously evaluated as an improvement by two independent judges who can't see who submitted.
That quality benchmark has increased from 70% at launch to 94% now.
This happened even though we made our judges MORE critical over time and capped the number of claims any miner can submit to 10, making it much harder for miners to get their work accepted into our Silver record.
The competition is working. Our miners are brilliant.
The next big step is coming soon.