vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
参加 March 2024
37 フォロー中 54.1K ファン
The vLLM community is coming to #PyTorchCon#, Oct 20–21 in San Jose! 🎉
Explore talks on attention, KV transfer, prefix caching, the vLLM roadmap & more.
📅 Build your schedule:
We can't wait to see you there! 🙌
もっと見る
