vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
36 Following 53.3K Followers
We're excited to Co-host Open Together with @huggingface! We'll kick off Open Source AI Week with a gathering of community open source builders.
The event is Friday October 16th in SF at The Midway.
Register here:
Show more
