steve(@gpusteve):my team figured out how to run Kimi K3 on @AMD MI355X at 952 tok/s/node and 118 tok/s single stream. 3.8x the aggregate throughput/node and 1.3x the single stream decode of B200 and beat B300 on performance per dollar: 48 vs 33 tok/s/$ details in reply

steve

@gpusteve

cofounder @wafer_ai ⿻ prev @twosigma, @google, @seinetwork, @uchicago

加入 May 2025

1.5K 正在關注 5.1K 粉絲

steve@gpusteve

2026.08.01 18:59

my team figured out how to run Kimi K3 on @AMD MI355X at 952 tok/s/node and 118 tok/s single stream. 3.8x the aggregate throughput/node and 1.3x the single stream decode of B200 and beat B300 on performance per dollar: 48 vs 33 tok/s/$ details in reply