注册并分享邀请链接,可获得视频播放与邀请奖励。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在关注    50.4K 粉丝
Good to see @RedNote back with a new open model, and a much bigger one built for long-horizon agent work. dots3-note preview is a 280B MoE with 16B active at 512K context, it reads images, audio, and video, and it is trained to explore unfamiliar environments and update its own memory as it goes. Out from @dotsstudioai under Apache 2.0, with day-0 support in vLLM. 🚀 Thanks to the @dotsstudioai team for the collaboration. 🙌 🔗
显示更多
0
7
111
11
转发到社区