vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
37 ํ๋ก์ ์ค 54.1K ํฌ
76 guest speakers, 24 organizations, 59 sessions โ and every one driven by this community ๐ท Thank you @RedHat_AI and all our guests. Join us bi-weekly, open to all:
76 guest speakers. 24 organizations. 59 sessions and counting.
vLLM Office Hours is a bi-weekly livestream with the people building @vllm_project: a project update, a guest talk, and open Q&A. Open to all.
Get a calendar invite:
๋ ๋ณด๊ธฐ
