Inferact(@inferact):Great collaborating with @deepseek_ai, @nvidia, and @SemiAnalysis_ to build this with the @vllm_project community. Dropping TTFT nearly 70% at ~100K throughput reflects the joint work across models, custom kernels, and engine serving. vLLM is the open source engine; Inferact optimizes it and brings enterprise inference to production.

2026.10.08 01:21

Great collaborating with @deepseek_ai, @nvidia, and @SemiAnalysis_ to build this with the @vllm_project community. Dropping TTFT nearly 70% at ~100K throughput reflects the joint work across models, custom kernels, and engine serving. vLLM is the open source engine; Inferact optimizes it and brings enterprise inference to production.

vLLM@vllm_project

2026.10.07 20:42

4/ Together, TTFT drops nearly 70% at ~100K throughput. Thanks to @deepseek_ai for the model and kernels, @nvidia for the collaboration, and @SemiAnalysis_ for AgentX. Built by @inferact and the vLLM community.

轉發到社區