vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
가입 March 2024
36 팔로잉 중 53.3K 팬
We're excited to Co-host Open Together with @huggingface! We'll kick off Open Source AI Week with a gathering of community open source builders.
The event is Friday October 16th in SF at The Midway.
Register here:
더 보기
