vLLM(@vllm_project):Congrats to @Kimi_Moonshot on the Kimi K3 announcement! 🎉 Grateful for the shoutout and collab. The Kimi team announced they contributed a KDA prefix caching implementation directly to vLLM, to be released alongside the model. 🚀 KDA breaks assumptions behind conventional prefix caching, and this upstream work means the community gets efficient long-context serving from day 0. vLLM will support Kimi K3 on day-0 release. Open weights by July 27, 2026.

vLLM

@vllm_project

A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!

가입 March 2024

36 팔로잉 중 45.4K 팬

vLLM@vllm_project

2026.07.16 19:39

Congrats to @Kimi_Moonshot on the Kimi K3 announcement! 🎉 Grateful for the shoutout and collab. The Kimi team announced they contributed a KDA prefix caching implementation directly to vLLM, to be released alongside the model. 🚀 KDA breaks assumptions behind conventional prefix caching, and this upstream work means the community gets efficient long-context serving from day 0. vLLM will support Kimi K3 on day-0 release. Open weights by July 27, 2026.

384

커뮤니티로 전달

인기 있는 사용자