Ning
@totheagi
Building agent empire.
ex google brain (tensorflow, TPU), Fudan CS.
가입 November 2022
196 팔로잉 중 4.3K 팬
one week of pushing Kimi K3 on the 80x 5090s. where are we now:
peak single stream: 95 tok/s
aggregate decode: 1386 tok/s
prefill: 13180 tok/s
we still see a lot of potential. that's about 10% of what these cards can actually stream.
더 보기
