注册并分享邀请链接,可获得视频播放与邀请奖励。

Inferact
@inferact
Building the future of inference through @vllm_project
加入 December 2025
5 正在关注    8.3K 粉丝
Great collaborating with @deepseek_ai, @nvidia, and @SemiAnalysis_ to build this with the @vllm_project community. Dropping TTFT nearly 70% at ~100K throughput reflects the joint work across models, custom kernels, and engine serving. vLLM is the open source engine; Inferact optimizes it and brings enterprise inference to production.
显示更多
4/ Together, TTFT drops nearly 70% at ~100K throughput. Thanks to @deepseek_ai for the model and kernels, @nvidia for the collaboration, and @SemiAnalysis_ for AgentX. Built by @inferact and the vLLM community.
显示更多