vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
37 ํ๋ก์ ์ค 54.1K ํฌ
Get started with Muse Spark Open:
NVIDIA: vllm/vllm-openai:muse-spark-open
AMD: vllm/vllm-openai-rocm:muse-spark-open
Recipe:
Model:
Technical deep dive:
Thanks to everyone involved for the great collaboration! ๐ค
6/6
๋ ๋ณด๊ธฐ
