Inferact(@inferact):Kimi K3 on @vllm_project is now 2.2–2.8× faster 🚀 Inferact is proud to have co-led this optimization effort with @RedHat_AI, @NVIDIAAI, and @Huawei, spanning scheduling, KDA state handling, and custom MoE kernels. Read the technical deep dive:

2026.09.18 07:03

Kimi K3 on @vllm_project is now 2.2–2.8× faster 🚀 Inferact is proud to have co-led this optimization effort with @RedHat_AI, @NVIDIAAI, and @Huawei, spanning scheduling, KDA state handling, and custom MoE kernels. Read the technical deep dive:

显示更多

vLLM@vllm_project

2026.09.17 15:57

Kimi K3 serving in vLLM now delivers 2.2–2.8x throughput on our B300 benchmark vs v0.27.1. We break down the work across scheduling, KDA state handling, and MoE kernels, with benchmarks and commands to reproduce the results. Thanks to the vLLM community for pushing Kimi K3 performance forward! Read the deep dive:

显示更多

转发到社区