Register and share your invite link to earn from video plays and referrals.

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
Joined March 2024
37 Following    54.1K Followers
One router, two minds 🧠⚡ Huge work from @XunzhuoLiu and the vLLM Semantic Router team on System Duo — fast decision models handle the blink-of-an-eye calls (triage, guard, verify, check), while the router sends deep reasoning to the right model only when it matters. All open source, all running on vLLM →
Show more
𝗠𝗮𝗸𝗲 𝘆đ—ŧ𝘂đ—ŋ 𝗮𝗴𝗲đ—ģ𝘁 𝘁đ—ĩđ—ļđ—ģ𝗸 đ—ŗđ—Žđ˜€đ˜ 𝗮đ—ģ𝗱 𝘀𝗹đ—ŧ𝘄. System One decides in a blink. System Two reasons in depth. đ—ĸđ—ģ𝗲 đ—ŋđ—ŧ𝘂𝘁𝗲đ—ŋ. 𝗧𝘄đ—ŧ đ—ēđ—ļđ—ģ𝗱𝘀. 𝗜đ—ģ𝘁đ—ŋđ—ŧ𝗱𝘂𝗰đ—ļđ—ģ𝗴 đ—Ļ𝘆𝘀𝘁𝗲đ—ē 𝗗𝘂đ—ŧ → #Jev# #SystemOne# #SystemTwo# #OpenSource#
Show more