vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37 Following 54.5K Followers
The vLLM community is coming to #PyTorchCon#, Oct 20â21 in San Jose! đ
Explore talks on attention, KV transfer, prefix caching, the vLLM roadmap & more.
đ
Build your schedule:
We can't wait to see you there! đ
Show more
