vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
参加 March 2024
36 フォロー中 50.2K ファン
Thank you to everyone who showed up, spoke, and stayed throughout the vLLM Conference. Lines out the door for talks say a lot about this community.
Thank you to @inferact for hosting! Session recordings are in the thread.
もっと見る
That's a wrap on the @vllm_project Conference at Ray Summit. Lines out the door for talks about an inference engine—that says everything about how much this community shows up.
Thank you to @anyscalecompute for co-hosting with us, and we're already looking forward to the next event.
もっと見る
