vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
36 ํ๋ก์ ์ค 50.2K ํฌ
A stronger open AI ecosystem is built by communities ๐
Great to see @PyTorch bringing the community together and the open AI ecosystem continuing to grow across China โค๏ธ
