Register and share your invite link to earn from video plays and referrals.

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37 Following    54.1K Followers
Great to see MiniMax M3.1 Flash running in production at scale, served by @inferact with guaranteed SLAs โ€” and the engineering improvements flowing back upstream to vLLM. This is what the open-source inference ecosystem is all about. Welcome @MiniMax_AI! ๐Ÿ“ท
Show more
Weโ€™re partnering with Inferact to advance production inference for MiniMax models, with engineering improvements contributed back to @vllm_project. Thanks to the Inferact team for supporting M3.1 Flash in production from day one. Looking forward to building together!
Show more