註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在關注    54.5K 粉絲
Vela 2.0 brings span-level decisions to routing: safety checks, domain classification, PII spans and unsupported claims in one call. Built by vLLM Semantic Router and KR Labs. Four sizes, 0.3B to 9B. Apache-2.0.
顯示更多
0
18
163
13
轉發到社區