Cheng Lou
@_chenglou
Joined January 2015
432 Following 68.7K Followers
Once this comes to inference we’ll have seeded reproducible agent runs
Floating point math is not associative! And many of the highest performance kernels split the workload among SMs and accumulate partial results in a nondeterministic order. Many AI labs just accept this, or pay a huge performance penalty for determinism. DeepSeek decided to do neither. (1/4) 🧵
Show more
