vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在关注 53.3K 粉丝
We're excited to Co-host Open Together with @huggingface! We'll kick off Open Source AI Week with a gathering of community open source builders.
The event is Friday October 16th in SF at The Midway.
Register here:
显示更多
