always on, small LLM data agents + monitors will be a significant chunk of global inference in the next few years
every team will have constantly running agents turning their live agent data into potential SFT + RL data to train the next generation of models
- agents will produce more data in the next few years than humans have in their history
- data is the currency that improves models over time & real world signal is the best reflection of what agents need to be good at
- compute spent on data generation grows every year, this is a pre-req for doing training
like with all compute, as intelligence increases, we’ll continue to use exponentially more compute to make use of it