vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
๊ฐ์
March 2024
36 ํ๋ก์ ์ค 45.4K ํฌ
London, June 10 ๐ฌ๐ง โ come talk inference with the vLLM core + @_llm_d_ crew. Thanks @RedHat_AI for hosting. ๐
