Register and share your invite link to earn from video plays and referrals.

Artificial Analysis
@ArtificialAnlys
Independent analysis of AI
Joined January 2024
682 Following    150.8K Followers
Announcing Multilingual Text to Speech Arena Leaderboards, comparing leading TTS models across 9 languages beyond English đŸ‡¯đŸ‡ĩ đŸ‡¨đŸ‡ŗ đŸ‡ŽđŸ‡ŗ đŸ‡Ē🇸 🇩đŸ‡Ē đŸ‡Ģ🇷 đŸ‡ĩ🇹 đŸ‡ģđŸ‡ŗ 🇸đŸ‡Ļ Text to Speech performance varies significantly across languages, with models that perform well in English not necessarily delivering the same pronunciation, pacing, tone, and naturalness in other languages. We have extended the Artificial Analysis Controlled Voice Arena to 9 new languages: Japanese đŸ‡¯đŸ‡ĩ, Mandarin Chinese đŸ‡¨đŸ‡ŗ, Hindi đŸ‡ŽđŸ‡ŗ, Spanish đŸ‡Ē🇸, German 🇩đŸ‡Ē, French đŸ‡Ģ🇷, Portuguese đŸ‡ĩ🇹, Vietnamese đŸ‡ģđŸ‡ŗ, and Arabic 🇸đŸ‡Ļ. Each model is evaluated using standardized cloned voices, with prompts written natively in each language and preference votes collected from first-language speakers. Elo scores are calculated independently for each language, allowing each leaderboard to reflect model preferences among speakers of that language. Key results: ➤ @Cartesia's Sonic family leads 8 of the 9 new language leaderboards, with Sonic 3.6 ranking #1# in 7 languages and Sonic 3.5 leading Portuguese. @InworldAI's Realtime TTS-2 takes the #1# spot in Mandarin. ➤ @ElevenLabs' Eleven v3 family ranks in the top 3 across 7 of the 9 new languages, through Eleven v3 and Eleven v3 Conversational. ➤ Inworld's Realtime TTS-2 leads Mandarin at 1,185 Elo, ahead of Sonic 3.6 at 1,146 and StepFun's StepAudio 2.5 TTS at 1,130. Realtime TTS-2 also ranks #1# in English (US). ➤ More than 100,000 human preference votes have been collected across the 9 new language leaderboards, with 15 to 24 public models ranked per language. See the per-language results below âŦ‡ī¸
Show more