๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ€์ž… March 2024
37 ํŒ”๋กœ์ž‰ ์ค‘    54.1K ํŒฌ
Great to see MiniMax M3.1 Flash running in production at scale, served by @inferact with guaranteed SLAs โ€” and the engineering improvements flowing back upstream to vLLM. This is what the open-source inference ecosystem is all about. Welcome @MiniMax_AI! ๐Ÿ“ท
๋” ๋ณด๊ธฐ
Weโ€™re partnering with Inferact to advance production inference for MiniMax models, with engineering improvements contributed back to @vllm_project. Thanks to the Inferact team for supporting M3.1 Flash in production from day one. Looking forward to building together!
๋” ๋ณด๊ธฐ