João Maria Janeiro(@JoaoMJaneiro):🚨New Paper @AIatMeta 🚨 You want to train a largely multilingual model, but languages keep interfering and you can’t boost performance? Using a dense model is suboptimal when mixing many languages, so what can you do? You can use our new architecture Mixture of Languages! 🧵1/n

João Maria Janeiro

@JoaoMJaneiro

PhD Student @ Meta AI Paris & Sorbonne University | 🇵🇹

加入 November 2022

172 正在關注 112 粉絲

João Maria Janeiro@JoaoMJaneiro

2025.11.05 19:13

🚨New Paper @AIatMeta 🚨 You want to train a largely multilingual model, but languages keep interfering and you can’t boost performance? Using a dense model is suboptimal when mixing many languages, so what can you do? You can use our new architecture Mixture of Languages! 🧵1/n