vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在關注 45.4K 粉絲
If vLLM adopted a mascot….what would it be? Animal, object, character?
Drop any ideas or suggestions below 👀
