vLLM(@vllm_project):Serving AI at scale brings real tradeoffs in cost, latency, and capacity. Hear from vLLM core maintainer Tyler Michael Smith on inference economics in San Jose, Oct 19. Thanks @RedHat, @NVIDIAAI, and @IBM for bringing the community together!

vLLM

@vllm_project

A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!

加入 March 2024

37 正在關注 54.5K 粉絲

vLLM@vllm_project

2026.10.08 01:18

Serving AI at scale brings real tradeoffs in cost, latency, and capacity. Hear from vLLM core maintainer Tyler Michael Smith on inference economics in San Jose, Oct 19. Thanks @RedHat, @NVIDIAAI, and @IBM for bringing the community together!

轉發到社區

熱門用戶

4.3M 粉絲

26.5M 粉絲

2M 粉絲

579.2K 粉絲

28.3K 粉絲

101.8K 粉絲

260.1K 粉絲

40.7K 粉絲

3.4M 粉絲

182.9K 粉絲

549.8K 粉絲

140.2K 粉絲

233.2K 粉絲

111K 粉絲

2.1M 粉絲