注册并分享邀请链接,可获得视频播放与邀请奖励。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在关注    54.7K 粉丝
Great to see MiniMax M3.1 Flash running in production at scale, served by @inferact with guaranteed SLAs — and the engineering improvements flowing back upstream to vLLM. This is what the open-source inference ecosystem is all about. Welcome @MiniMax_AI! 📷
显示更多
We’re partnering with Inferact to advance production inference for MiniMax models, with engineering improvements contributed back to @vllm_project. Thanks to the Inferact team for supporting M3.1 Flash in production from day one. Looking forward to building together!
显示更多