Co-Founder, CTO-CPO of @SentoraHQ (fmr IntoTheBlock), Co-Founder of @layerlens_ai, @neuralfabric( acq by Cisco) and The Sequence, Teaching at Columbia-Wharton
My essay at TheSequence today covers the topic of environments in AI post-training
AI environments are becoming a core ingredient of model capability: executable worlds that generate trajectories and feedback, not just exams. This essay traces their path from Atari, OpenAI Gym, and AlphaZero through MuJoCo to the RLVR-driven post-training behind Tulu 3 and DeepSeek-R1, then surveys the new generation of agent environments, including SWE-Gym, WebArena, OSWorld, TheAgentCompany, Tau2-bench, and AgentMercury.
Check it out: