注册并分享邀请链接,可获得视频播放与邀请奖励。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在关注    54.6K 粉丝
Serving AI at scale brings real tradeoffs in cost, latency, and capacity. Hear from vLLM core maintainer Tyler Michael Smith on inference economics in San Jose, Oct 19. Thanks @RedHat, @NVIDIAAI, and @IBM for bringing the community together!
显示更多