Ravid Shwartz Ziv
@ziv_ravid
AI researcher | Meta | NYU. Working on compression, representation learning, and memory. I have an AI podcast!
Joined July 2020
3.7K Following 14.2K Followers
Kimi K3 weights and the technical report are out. If there are 100 likes here, I'm writing a blog post on what is new there, for 50, I will do a tweet...
Releasing the model weights and technical report of Kimi K3.
Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window.
New model architecture: 2.5x the intelligence per unit of compute, not just more params.
Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale.
Model weights:
Tech report:
Tech blog:
Show more
