vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
37 ํ๋ก์ ์ค 54.1K ํฌ
Love seeing what the community builds on vLLM-Omni ๐คฉ OpenDirector: a local short-film workspace โ generate, edit, export โ powered by vLLM-Omni with a wide range of models. Congrats @hsliuunc! ๐ฌ
๐ฅ OpenDirector:
โก vLLM-Omni:
๋ ๋ณด๊ธฐ
