vLLM(@vllm_project):vLLM v0.33.0 is out! 🚀 927 commits · 389 contributors · 122 first-timers 🤖 New models: Reflection Beam-1.0, Step-5 Preview, Nemotron Parse 3.5, MiniCPM-OCR 1.0 🔥 PyTorch 2.14 — CUDA 13.0-only wheels, libtorch ABI-stable 🎲 Spec decoding: XPress refiner, FLy lossy verify (1.04–1.31x), DSpark 1373→3390 tok/s on GB300 ⚡ NVIDIA decode: 1.5–2x latency decode on GB300, FA4 sparse MLA, 39–48% lower TTFT 🚀 New AWS EFA image + shorter vllm/vllm name 🐧 ROCm 10.0 default, MonoKernel 2.32x P50 Full notes ➡️

vLLM

@vllm_project

A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!

参加 March 2024

37 フォロー中 54.1K ファン

vLLM@vllm_project

2026.11.03 23:53

vLLM v0.33.0 is out! 🚀 927 commits · 389 contributors · 122 first-timers 🤖 New models: Reflection Beam-1.0, Step-5 Preview, Nemotron Parse 3.5, MiniCPM-OCR 1.0 🔥 PyTorch 2.14 — CUDA 13.0-only wheels, libtorch ABI-stable 🎲 Spec decoding: XPress refiner, FLy lossy verify (1.04–1.31x), DSpark 1373→3390 tok/s on GB300 ⚡ NVIDIA decode: 1.5–2x latency decode on GB300, FA4 sparse MLA, 39–48% lower TTFT 🚀 New AWS EFA image + shorter vllm/vllm name 🐧 ROCm 10.0 default, MonoKernel 2.32x P50 Full notes ➡️