steve(@gpusteve):my team figured out how to run Kimi K3 on @AMD MI355X at 952 tok/s/node and 118 tok/s single stream. 3.8x the aggregate throughput/node and 1.3x the single stream decode of B200 and beat B300 on performance per dollar: 48 vs 33 tok/s/$ details in reply

steve

@gpusteve

cofounder @wafer_ai ⿻ prev @twosigma, @google, @seinetwork, @uchicago

参加 May 2025

1.5K フォロー中 5.1K ファン

steve@gpusteve

2026.08.01 18:59

my team figured out how to run Kimi K3 on @AMD MI355X at 952 tok/s/node and 118 tok/s single stream. 3.8x the aggregate throughput/node and 1.3x the single stream decode of B200 and beat B300 on performance per dollar: 48 vs 33 tok/s/$ details in reply