注册并分享邀请链接,可获得视频播放与邀请奖励。

Inferact
@inferact
Building the future of inference through @vllm_project
加入 December 2025
5 正在关注    8.3K 粉丝
Inferact now serves more than 7 trillion tokens a day. That traffic runs on the Inferact Platform, which serves frontier models with optimized vLLM across heterogeneous hardware and diverse workloads. For context, OpenRouter averaged 19 trillion tokens a day of open-weight traffic over the past 30 days, across all of its providers. The platform improves through a data flywheel. Production traffic shows us where to improve vLLM, partnerships with accelerators like NVIDIA, AMD, and Google bring those improvements to new hardware, and partnerships with model labs like MiniMax and Kimi bring them to new models from launch day. Next, we’re automating that flywheel with agents that find and validate optimizations on their own, so the platform improves with every token it serves.
显示更多
0
3
200
23
转发到社区