Kimi K3 is now on Amazon Bedrock!
Run coding, document analysis, and extended agent workflows with Bedrock's access, encryption, and auditing controls. Explicit prompt caching supported.
Start building with K3 on AWS 👉
Kimi K3 serving in vLLM now delivers 2.2–2.8x throughput on our B300 benchmark vs v0.27.1.
We break down the work across scheduling, KDA state handling, and MoE kernels, with benchmarks and commands to reproduce the results.
Thanks to the vLLM community for pushing Kimi K3 performance forward!
Read the deep dive:
Kimi K3 was released ~2 months ago, causing an uproar by the community due to its cyber capabilities being available in an open model
There has been no documented case of K3 causing harm so far