熊师傅 weight decay 了吗
@bigeagle_xd
a person living with @mianmoe, opinions are my own
加入 February 2010
1.3K 正在關注 11.9K 粉絲
a great summary of the past year's work.
time to move on and carry on 🫡
Releasing the model weights and technical report of Kimi K3.
Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window.
New model architecture: 2.5x the intelligence per unit of compute, not just more params.
Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale.
Model weights:
Tech report:
Tech blog:
顯示更多
