vLLM(@vllm_project):Beyond matching DeepInfer's performance, we also put vLLM to the test on @SemiAnalysis_ AgentX with real-world agentic workloads. At DeepSeek's off-peak pricing, vLLM delivers $38.96/GPU-hour revenue, with 954K tokens/s/GPU total throughput (cached+input+output) at 196 tokens/s P90 per user. This is the best DeepSeek-V4.1-Flash result on AgentX ever, powered by recent advancement in vLLM! Check out our blog for the full optimization story and how to reproduce the results 👇 Enjoy the read.

2026.10.24 23:23

Beyond matching DeepInfer's performance, we also put vLLM to the test on @SemiAnalysis_ AgentX with real-world agentic workloads. At DeepSeek's off-peak pricing, vLLM delivers $38.96/GPU-hour revenue, with 954K tokens/s/GPU total throughput (cached+input+output) at 196 tokens/s P90 per user. This is the best DeepSeek-V4.1-Flash result on AgentX ever, powered by recent advancement in vLLM! Check out our blog for the full optimization story and how to reproduce the results 👇 Enjoy the read.

显示更多

vLLM@vllm_project

2026.10.24 17:59

Scaled out with P/D disaggregation and Wide-EP on a GB300 NVL72 rack, vLLM serves V4.1-Flash on SemiAnalysis AgentX at 954K tokens/s per GPU with 196 tokens/s P90 per user, 7.9× our single-node result. Our engineering blog covers the work behind it:

显示更多