Very few people realize how closely RL environments and agent simulations go hand in hand.
Most RL environments today are still static snapshots. Take coding or tool use: the repo, tools, APIs, data, etc. are already set up, and the agent acts on that existing state.
But as environments get more sophisticated, you need to simulate the world around the agent: code reviews, email/message responses, user feedback, other agents, changing state...
Doing this realistically, while keeping the environment verifiable and not reward-hackable, is a really fun problem to solve.
显示更多