vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
37 正在关注 54.1K 粉丝
🚀 Day-0 vLLM support for Sage-A1.5 (35B MoE, 3B active) from Shanghai AI Lab — agentic intelligence you can serve locally today:
vllm serve InternScience/Sage-A1.5
Congrats @sageai_official ! 🔥
显示更多
🚀Sage-A1.5 by Shanghai AI Lab is here — pushing 35B agentic intelligence to the next level 🔥
🤖 35B MoE (3B active)
🧩 Agentic Orchestration & Verification — spawns parallel subagents & self-corrects on the fly
🔄 RSI Data Flywheel — evolved via real scientific discovery workflows & tens of thousands of synthesized environments
🚀 Beats frontier giants on FS-Olympiad, FS-Research, CMT & PinchBench, and hits 61.2% on SWE-Bench Pro
💻 Runs locally via vLLM（@vllm_project）, SGLang（@sgl_project）, llama.cpp & LM Studio (Q4_K_M ~20GB)
Scale the Horizon, Compose the Capabilities 👇
🔗 Model:
@huggingface
@ModelScope2022
🕹️ Try it free:
显示更多
