Engy
@engyai
Verifiable inference for frontier open models.
Joined October 2020
4 Following 2.9K Followers
Kimi K3 is live on
next: DeepSeek V4 Flash and Qwen3.8.
one week of pushing Kimi K3 on the 80x 5090s. where are we now:
peak single stream: 95 tok/s
aggregate decode: 1386 tok/s
prefill: 13180 tok/s
we still see a lot of potential. that's about 10% of what these cards can actually stream.
Show more
