注册并分享邀请链接,可获得视频播放与邀请奖励。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在关注    54.7K 粉丝
The vLLM community is coming to #PyTorchCon#, Oct 20–21 in San Jose! 🎉 Explore talks on attention, KV transfer, prefix caching, the vLLM roadmap & more. 📅 Build your schedule: We can't wait to see you there! 🙌
显示更多