SemiAnalysis
@SemiAnalysis_
参加 January 2024
29 フォロー中 149.3K ファン
Floating point math is not associative! And many of the highest performance kernels split the workload among SMs and accumulate partial results in a nondeterministic order. Many AI labs just accept this, or pay a huge performance penalty for determinism. DeepSeek decided to do neither. (1/4) 🧵
もっと見る
