Register and share your invite link to earn from video plays and referrals.

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37 Following    54.1K Followers
Serving AI at scale brings real tradeoffs in cost, latency, and capacity. Hear from vLLM core maintainer Tyler Michael Smith on inference economics in San Jose, Oct 19. Thanks @RedHat, @NVIDIAAI, and @IBM for bringing the community together!
Show more