vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
36 Following 50.2K Followers
A stronger open AI ecosystem is built by communities đ
Great to see @PyTorch bringing the community together and the open AI ecosystem continuing to grow across China â¤ī¸
