vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在關注 50.2K 粉絲
Thank you to everyone who showed up, spoke, and stayed throughout the vLLM Conference. Lines out the door for talks say a lot about this community.
Thank you to @inferact for hosting! Session recordings are in the thread.
顯示更多
That's a wrap on the @vllm_project Conference at Ray Summit. Lines out the door for talks about an inference engine—that says everything about how much this community shows up.
Thank you to @anyscalecompute for co-hosting with us, and we're already looking forward to the next event.
顯示更多
