註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Claire Lehmann
@clairlemon
Founder, editor @quillette, contributing writer @australian, @thedispatch 📧 subscribe:
加入 May 2013
6.8K 正在關注    250.3K 粉絲
Digital mad cow disease
Researchers proved every LLM trained on AI-generated content develops an irreversible genetic disorder. They call it "Model Collapse" When you train an AI on internet data, it learns the patterns of human language. When the internet fills up with AI-generated text, future AIs start training on that synthetic data. Then the next generation trains on the AI's version of the AI. It is the digital equivalent of inbreeding. With every single generation of recycling, the model loses touch with reality. Rare events vanish entirely. The tails of the distribution get chopped off. The AI forgets what normal human writing actually looks like, and the output degenerates into pure, repetitive statistical gibberish. The scariest part? It is completely irreversible. Once a model goes through collapse, you cannot patch it by throwing clean data back into the mix. The underlying architecture's genetic code is permanently corrupted. We are actively flooding the internet with synthetic content every single day. We are poisoning the well that the next generation of models has to drink from. If the future of the internet is just AI talking to AI, the data supply chain is about to rot from the inside out. —— to clarify real quick: it's not a literal biological "genetic disorder" since ai doesn't have dna, but researchers actually do call it "ai inbreeding," "habsburg ai," or "mad" (model autophagy disorder) because the mathematical effect is basically the exact same thing.
顯示更多
0
19
163
14
轉發到社區