vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
参加 March 2024
37 フォロー中 54.1K ファン
Get started with Muse Spark Open:
NVIDIA: vllm/vllm-openai:muse-spark-open
AMD: vllm/vllm-openai-rocm:muse-spark-open
Recipe:
Model:
Technical deep dive:
Thanks to everyone involved for the great collaboration! 🤝
6/6
もっと見る
