註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在關注    54.1K 粉絲
Great to see MiniMax M3.1 Flash running in production at scale, served by @inferact with guaranteed SLAs — and the engineering improvements flowing back upstream to vLLM. This is what the open-source inference ecosystem is all about. Welcome @MiniMax_AI! 📷
顯示更多
We’re partnering with Inferact to advance production inference for MiniMax models, with engineering improvements contributed back to @vllm_project. Thanks to the Inferact team for supporting M3.1 Flash in production from day one. Looking forward to building together!
顯示更多