註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

vLLM
@vllm_project
A high-throughput and memory-efficient inference and serving engine for LLMs. Join to discuss together with the community!
加入 March 2024
36 正在關注    50.3K 粉絲
Good to see @RedNote back with a new open model, and a much bigger one built for long-horizon agent work. dots3-note preview is a 280B MoE with 16B active at 512K context, it reads images, audio, and video, and it is trained to explore unfamiliar environments and update its own memory as it goes. Out from @dotsstudioai under Apache 2.0, with day-0 support in vLLM. 🚀 Thanks to the @dotsstudioai team for the collaboration. 🙌 🔗
顯示更多
0
7
111
11
轉發到社區