vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在关注 38.6K 粉丝
🎉 Day-0 vLLM support for Intern-S2-Preview!
Congrats to the @intern_lm team — an open-source scientific multimodal foundation model, with a first take on material crystal structure generation alongside general capabilities.
📖
显示更多
🥳Introducing Intern-S2-Preview, an efficient 35B scientific multimodal foundation model.
1⃣Delivers performance comparable to the trillion-scale Intern-S1-Pro on core scientific tasks.
2⃣The first open-source model with material crystal structure generation capabilities and strong general capabilities.
3⃣Significantly stronger scientific agent capabilities on multiple benchmarks.
4⃣Improves MTP acceptance rate and token generation speed via shared-weight MTP + KL loss.
5⃣CoT compression shortens responses while preserving strong reasoning , improving both performance and efficiency.
🥰Now supported by vLLM (@vllm_project) and SGLang ( @lmsysorg ) — with more ecosystem integrations on the way.
🤗Model：
@huggingface
@ModelScope2022
🤗GitHub:
🤗Try it now at:
显示更多
