Register and share your invite link to earn from video plays and referrals.

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37 Following    54.1K Followers
Thanks to @SemiAnalysis_ for highlighting the vLLM ecosystem’s work on TPU, in particular the Kimi K3 megakernel and vLLM TorchTPU powering AgentX results across GLM-5.2, Qwen3.5 397B, and Kimi K3. Shoutout to @inferact and @googlecloud for pushing vLLM performance on TPU. The @SemiAnalysis_ write-up below is a great read 👇
Show more
The Iron(wood) Throne: Google's TPU Stakes Its Claim on Inference Viable Alternative of CUDA Moat, NVIDIA Working Nights & Weekends, Jensen’s Counter Submission, Kimi K3, Meta Muse Spark Open, GLM5.3, TorchTPU, SGLang, vLLM, llm-d, Ray
Show more