vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
36 ํ๋ก์ ์ค 52.9K ํฌ
High throughput on the grill. Zero latency on the drinks.
vLLM maintainers and friends gathered during the PyTorch Conference for an evening of Brazilian steak, drinks, and great conversation! ๐ฅฉ๐ฅ
Grateful for this community and everyone who keeps vLLM moving forward. ๐
๋ ๋ณด๊ธฐ
