vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
36 ํ๋ก์ ์ค 38.6K ํฌ
๐ Day-0 vLLM support for Qwen3.6-27B!
Congrats to @Alibaba_Qwen on the new 27B dense model release.
Looking forward to more of the Qwen3.6 series. ๐
๐ Recipe:
๋ ๋ณด๊ธฐ
