vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在關注 54.1K 粉絲
The vLLM community is coming to #PyTorchCon#, Oct 20–21 in San Jose! 🎉
Explore talks on attention, KV transfer, prefix caching, the vLLM roadmap & more.
📅 Build your schedule:
We can't wait to see you there! 🙌
顯示更多
