vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
37 ํ๋ก์ ์ค 54.1K ํฌ
We're co-hosting a @vllm_project x @nvidia Dynamo Meetup during vLLM Conference week in San Francisco โก
Tech talks on serving LLMs efficiently at scale + food, drinks, and the inference community all in one room
๐
Aug 24, 6โ9pm PT
Space is limited โ RSVP:
๋ ๋ณด๊ธฐ
