vLLM × PyTorch: with the LibTorch Stable ABI, new PyTorch releases no longer force a vLLM rebuild 📷 Users upgrade sooner, distributors rebuild less, devs test torch changes without recompiling vLLM. Read the migration story:

vLLM Office Hours #58# recording is up: - What's new in vLLM v0.29 and v0.30 - A new hardware backend from Tenstorrent - An intro to llm-d Semantic Classifier, a lightweight classification service for high-throughput routing - Why it isn't trying to be a guardrail Watch + see slides:

vLLM integrated PyNvVideoCodec to offload video decoding from CPU to GPU's NVDEC. Result: 2x+ throughput at 8×H100, CPU bottleneck gone! This is huge for video captioning at scale (AV training, metadata), and ships with CUDA vLLM releases. 🔗

vLLM @vllm_project sessions at #PyTorchCon# NA 2026 span the serving stack, from attention and KV cache management to disaggregated serving and hardware portability across accelerators. Speakers will cover attention and KV cache systems, disaggregated serving, expert parallelism, and vLLM across TPU, Trainium, Arm, and IBM Spyre. Featured speakers include: @RedHat: Lucas Wilkinson, Matthew Bonanni, Zhanqiu Hu, @rickynds, and Alex Brooks @amazon: Sunita Nadampalli @IBM: Or Ozeri, Thomas Parnell, and Dave Grove @Huawei: Mengqing Cao @nvidia: Itay Alroy @Google: @Rob_Mulla and Qi Zhou @awscloud: Maen Suleiman @Meta: Richard Zou, Colin Taylor, and Angela Yi @BAAIBeijing: Yonghua Lin @fujitsulabs: Abhishek Jain and N Maajid Khan @IBMResearch: Antoni Viros i Martin and Avery Blanchard @MistralAI: Nicolò Lucchesi @tensormesh: @this_will_echo @googlecloud: Bill Jia Register by September 4 to save: Read the vLLM session guide:

vLLM Office Hours #56# recording is up: - What's new in vLLM 0.27 - Running Codex and Claude Code CLIs on open models - Speculators v0.6 and v0.7 update - GuideLLM v0.7.0: benchmarking reasoning, tool calling, and agentic traces Watch + see slides:

vLLM Conference is next week, and we have a packed schedule 🎊 📅. Here's the full list of events you should know: Mon: 🔷 4–6PM vLLM × Ray × Google Cloud Happy Hour: 🔷 6–9PM vLLM × Dynamo Meetup: Tue: 🔷 11–11:30AM vLLM Keynote from @simon_mo_ 🔷 12–5PM vLLM Track Day 1 🔷 6–9PM vLLM × AMD Happy Hour: Wed: 🔷 12–5PM vLLM Track Day 2 🔷 6–8:30PM vLLM x DigitalOcean × NVIDIA Happy Hour: No ticket needed for the happy hours and meetups, but space is limited. To join the full event, register here:

vLLM Office Hours today at 2pm ET: RL at 1T Scale, a prime-rl performance deep dive with @m_sirovatka (@PrimeIntellect). Training trillion-parameter MoE models like GLM-5.1 on agentic RL, plus what's new in vLLM 0.25 by @mgoin_. Get a recurring cal invite:

vLLM Office Hours is back Thursday 🗓️ Topic: Latest Trends in AI Agent Applications and @vllm_project 2:00 PM ET | 11:00 AM PT Join us live with @AIatAMD to dig into where agentic AI and vLLM intersect. Get a calendar invite:

vLLM tops the Artificial Analysis leaderboard 🎉 vLLM tops @ArtificialAnlys on DeepSeek V3.2 and ranks among the top deployments of MiniMax-M2.5 and Qwen 3.5 397B. The leading deployments of these models are now open source. How each result was built: 🔹 DeepSeek V3.2 — Aggressive op fusion across the attention path collapsed ~33 per-layer kernels down toward ~10. 🔹 MiniMax-M2.5 — Custom EAGLE3 draft trained against the target's own token distribution via TorchSpec, plus a custom QK-norm fusion for MiniMax's TP-aware attention. 🔹 Qwen 3.5 397B — Targeted fusions plus a QK-norm fix for Qwen's linear-attention path. Every optimization is in vLLM main or on its way upstream. Huge thank you to @inferact, @digitalocean, @nvidia, @RedHat_AI, and the vLLM community 🙏 Full breakdown 👇

New vLLM Office Hours on advanced model compression, with Kyle Sayers and @_soyr_. They cover: - LLM Compressor's sequential pipeline and data parallel schemes - Settings most users never change - What observers do and how they affect quantization error - Expert pruning with REAP and MoNE