Ning
@totheagi
Building agent empire.
ex google brain (tensorflow, TPU), Fudan CS.
Joined November 2022
196 Following 4.3K Followers
one week of pushing Kimi K3 on the 80x 5090s. where are we now:
peak single stream: 95 tok/s
aggregate decode: 1386 tok/s
prefill: 13180 tok/s
we still see a lot of potential. that's about 10% of what these cards can actually stream.
Show more
