Guillaume Lample @ NeurIPS 2024(@GuillaumeLample):Today, we are launching a preview of our new model, Mistral Large 4 (ML4), aka le Chonk 🐈. ML4 is a 1T-parameter model with 49B active parameters, trained natively with multimodal capabilities. It is at the frontier of open models, and by far the strongest open-weight model from the US or Europe. The RL run behind this preview is still in flight and shows no sign of saturation -- we will release a final version before the end of the month along with the weights of the model. 🧵 1/n

Guillaume Lample @ NeurIPS 2024

@GuillaumeLample

Cofounder & Chief Scientist (@MistralAI). Working on LLMs. Ex @MetaAI | PhD @Sorbonne_Univ_ | MSc @CarnegieMellon | X11 @Polytechnique

加入 December 2016

651 正在關注 51.5K 粉絲

Guillaume Lample @ NeurIPS 2024@GuillaumeLample

2026.10.06 13:24

Today, we are launching a preview of our new model, Mistral Large 4 (ML4), aka le Chonk 🐈. ML4 is a 1T-parameter model with 49B active parameters, trained natively with multimodal capabilities. It is at the frontier of open models, and by far the strongest open-weight model from the US or Europe. The RL run behind this preview is still in flight and shows no sign of saturation -- we will release a final version before the end of the month along with the weights of the model. 🧵 1/n