In The Matrix, it becomes obvious it’s a simulation when the black cat appears twice.
World models fail similarly: visually the generated simulation looks realistic, but the underlying distribution is wrong.
Introducing CaliBench, a measurement of the randomness of reality!