vLLM(@vllm_project):Singapore, let's talk inference. Join the vLLM meetup with engineers from @inferact, @NVIDIA, @alibaba_cloud and the vLLM-Omni community: high-throughput prefill, RL, Blackwell, Vera Rubin, agent infrastructure and interactive world models. Nov 13 · 1–5:30 PM SGT · SQ Collective Free, with registration approval. Bring your serving questions. Meet the people building the stack.

vLLM

@vllm_project

A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!

参加 March 2024

36 フォロー中 53.6K ファン

vLLM@vllm_project

2hours ago

Singapore, let's talk inference. Join the vLLM meetup with engineers from @inferact, @NVIDIA, @alibaba_cloud and the vLLM-Omni community: high-throughput prefill, RL, Blackwell, Vera Rubin, agent infrastructure and interactive world models. Nov 13 · 1–5:30 PM SGT · SQ Collective Free, with registration approval. Bring your serving questions. Meet the people building the stack.