Ning
@totheagi
Building agent empire.
ex google brain (tensorflow, TPU), Fudan CS.
加入 November 2022
196 正在關注 4.3K 粉絲
one week of pushing Kimi K3 on the 80x 5090s. where are we now:
peak single stream: 95 tok/s
aggregate decode: 1386 tok/s
prefill: 13180 tok/s
we still see a lot of potential. that's about 10% of what these cards can actually stream.
顯示更多
