vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
가입 March 2024
36 팔로잉 중 50.2K 팬
Thank you to everyone who showed up, spoke, and stayed throughout the vLLM Conference. Lines out the door for talks say a lot about this community.
Thank you to @inferact for hosting! Session recordings are in the thread.
더 보기
That's a wrap on the @vllm_project Conference at Ray Summit. Lines out the door for talks about an inference engine—that says everything about how much this community shows up.
Thank you to @anyscalecompute for co-hosting with us, and we're already looking forward to the next event.
더 보기
