vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
36 Following 50.2K Followers
Thank you to everyone who showed up, spoke, and stayed throughout the vLLM Conference. Lines out the door for talks say a lot about this community.
Thank you to @inferact for hosting! Session recordings are in the thread.
Show more
That's a wrap on the @vllm_project Conference at Ray Summit. Lines out the door for talks about an inference engine—that says everything about how much this community shows up.
Thank you to @anyscalecompute for co-hosting with us, and we're already looking forward to the next event.
Show more
