註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Inferact
@inferact
Building the future of inference through @vllm_project
加入 December 2025
5 正在關注    8.3K 粉絲
Inferact now serves more than 7 trillion tokens a day. That traffic runs on the Inferact Platform, which serves frontier models with optimized vLLM across heterogeneous hardware and diverse workloads. For context, OpenRouter averaged 19 trillion tokens a day of open-weight traffic over the past 30 days, across all of its providers. The platform improves through a data flywheel. Production traffic shows us where to improve vLLM, partnerships with accelerators like NVIDIA, AMD, and Google bring those improvements to new hardware, and partnerships with model labs like MiniMax and Kimi bring them to new models from launch day. Next, we’re automating that flywheel with agents that find and validate optimizations on their own, so the platform improves with every token it serves.
顯示更多
0
3
200
23
轉發到社區