登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
参加 March 2024
37 フォロー中    54.1K ファン
One router, two minds 🧠⚡ Huge work from @XunzhuoLiu and the vLLM Semantic Router team on System Duo — fast decision models handle the blink-of-an-eye calls (triage, guard, verify, check), while the router sends deep reasoning to the right model only when it matters. All open source, all running on vLLM →
もっと見る
𝗠𝗮𝗸𝗲 𝘆𝗼𝘂𝗿 𝗮𝗴𝗲𝗻𝘁 𝘁𝗵𝗶𝗻𝗸 𝗳𝗮𝘀𝘁 𝗮𝗻𝗱 𝘀𝗹𝗼𝘄. System One decides in a blink. System Two reasons in depth. 𝗢𝗻𝗲 𝗿𝗼𝘂𝘁𝗲𝗿. 𝗧𝘄𝗼 𝗺𝗶𝗻𝗱𝘀. 𝗜𝗻𝘁𝗿𝗼𝗱𝘂𝗰𝗶𝗻𝗴 𝗦𝘆𝘀𝘁𝗲𝗺 𝗗𝘂𝗼 → #Jev# #SystemOne# #SystemTwo# #OpenSource#
もっと見る