🚨New Paper
@AIatMeta 🚨
You want to train a largely multilingual model, but languages keep interfering and you can’t boost performance? Using a dense model is suboptimal when mixing many languages, so what can you do?
You can use our new architecture Mixture of Languages!
🧵1/n