🚀 Mistral AI’s Voxtral Mini Transcribe 3 ranks #
2# out of 9 models by DER on Voice Arena’s Diarization + ASR leaderboard, outperforming its larger counterpart.
Following the launch of Mistral’s new Voxtral 3 family, we evaluated its Mini and Small transcription models on Voice Arena’s Diarization Bench.
🥈 Voxtral Mini Transcribe 3: 40.4% DER (#
2#)
Voxtral Small Transcribe 3: 41.1% DER (#
4#)
Both models were tested on 139 held-out conversations under identical conditions, using human-verified references, a strict 0 ms collar, and no predefined speaker counts or audio cleanup.
Mini leads on in-person conversations (40.6% vs. 41.5%), while Small performs slightly better on online calls (39.1% vs. 39.5%).
Overlapping speech remains the biggest challenge. Missed speech accounts for 82% of Mini's total DER. Both models correctly identify the exact number of speakers in 83.5% of sessions.
Congratulations to
@MistralAI on the release ! 👏
View complete track & condition breakdown: