vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37 Following 54.1K Followers
Get started with Muse Spark Open:
NVIDIA: vllm/vllm-openai:muse-spark-open
AMD: vllm/vllm-openai-rocm:muse-spark-open
Recipe:
Model:
Technical deep dive:
Thanks to everyone involved for the great collaboration! 🤝
6/6
Show more
