Mistral Large 4. 1T parameters, 49B active. They call it Le Chonk and they are not joking.
"The best open weights model from US or Europe." The weights come at the end of October. Today its an API. So right now its the best open weights model that has no weights.
And when they come, who runs it? 1T parameters is about 500GB at 4 bits. I have 96GB of VRAM on 4x 3090 and I am already the rich kid in this hobby.
Look at this week. Reflection Beam, 501B, weights "this month". Mistral, 1T, weights "end of October". The West discovered open weights all at once, and everybody built a model for a datacenter.
I am glad Europe is back, I mean it. Aleph Alpha shipped 78B with 3.46B active 3 days ago and the file was there on day 1. Thats how you do it.
Mistral, your 7B is how a lot of us started with local AI. Ship a small one too.
顯示更多
Meet Mistral Large 4, aka Le Chonk.
• 1T parameters, natively multimodal. 49B active.
It is the best open weights model from US or Europe on aggregated benchmarks.
• State-of-the-art on critical workloads, including cyber defense, manufacturing and finance and it surpasses closed frontier models on visual grounding.
• Forged in Europe end-to-end and is deployable from Europe via our own Mistral Cloud infrastructure.
• Available to all via API today. Working with cybersecurity partners privately.
Open weights release end of October.
顯示更多