vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在关注 52.9K 粉丝
High throughput on the grill. Zero latency on the drinks.
vLLM maintainers and friends gathered during the PyTorch Conference for an evening of Brazilian steak, drinks, and great conversation! 🥩🥂
Grateful for this community and everyone who keeps vLLM moving forward. 🚀
显示更多
