vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在关注 38.6K 粉丝
Congrats to @AntLingAGI on Ring-2.6-1T going open! 🎉
The thinking sibling of Ling-2.6-1T — trillion-scale, built for agent execution and complex reasoning.
Day-0 vLLM support is ready.
🤗
显示更多
