vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
37 ํ๋ก์ ์ค 54.1K ํฌ
Hola Madrid! ๐ช๐ธ vLLM is coming to town โ join us Nov 12 with @RedHat_AI and @NVIDIAAI for an evening of open-source inference: vLLM, vLLM-omni, LLM Compressor, and llm-d on Kubernetes. Register:
๋ ๋ณด๊ธฐ
