jianlin.su
@Jianlin_S
Grad&Clip&EM is all you need @Kimi_Moonshot
Blog: , Cool Papers:
Interesting link:
가입 February 2025
21 팔로잉 중 11.6K 팬
arrived as promised
Releasing the model weights and technical report of Kimi K3.
Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window.
New model architecture: 2.5x the intelligence per unit of compute, not just more params.
Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale.
Model weights:
Tech report:
Tech blog:
더 보기
