dream data generation agent:
1. tell agent what I need it to do
2. check if existing models already crush these tasks for near free
3. if not, Agent creates N RL tasks for this behavior
4. Audit tasks
5. Finetune very good, nearly free open model for those tasks
3 & 4 are hard
“Dream-RSI: Recursive Self-Improvement through Evolving Worlds”
AI agents can search for better solutions, but they’re usually stuck using the same search strategy over and over.
Dream-RSI lets the agent learn how to search better by turning its past exploration into a simulator, where it can cheaply replay different strategies before spending compute in the real world.
So the agent improves not just its solutions, but also the process it uses to discover them.