Today, LLMs are no longer built from human data alone. They rely on other LLMs to generate training data, filter corpora, evaluate outputs, provide rewards, and guide development decisions. So how many models and datasets is a modern LLM built on?
• OLMo 3 → 89 model + 183 dataset dependencies
• Nemotron 3 → 273 model + 560 dataset dependencies
How did we find it out? We built ModSleuth. 🧵
Show more
