🚀One of the biggest questions for AI agents is whether they can continue expanding their capabilities after deployment. Deployment brings the experience needed to keep improving. As @ilyasut has argued, future intelligent systems should learn from deployment. But this requires more than a new learning algorithm. It requires turning the serving stack itself into a learning layer: collecting live experience, turning it into updates, and safely bringing those updates back into serving. That’s why we built Reef. Reef is open-source infrastructure for continuously evolving agents at live deployment. To our knowledge, it is the first open-source infrastructure designed to evolve both model weights and the agent harness from deployment experience. Not just weights, but also prompts, memory, skills, tools, and orchestration. Reef already supports: 🧠Model evolution: SAO, TTT-Discover, OpenClaw-RL, with more recipes coming. 🛠️Harness evolution: SkillClaw, Meta-Harness, and a general harness-evolution engine built on Cordis, with native support for pi @pidotdev , OpenCode @opencode , and more harnesses coming. With Reef, inference is no longer the end of the pipeline. It becomes part of a continual loop: serve → learn → evolve → serve again. Reef is fully open source. We would love you to try it, build on it, and tell us what is missing! ⭐ GitHub: 💬 Discord: #AgenticAI# #llms#

Over the past few months, we’ve been thinking a lot about what it would actually take to build agents that continuously improve from their own experience. Today, we’re open-sourcing our continual learning infra, Reef. The idea is simple: instead of treating inference as the end of the pipeline, Reef turns live agent interactions into a continuous learning loop. It serves real applications, captures trajectories and feedback as structured experience, and lets different learning recipes use that experience to improve the system. What evolves isn’t just the model. Reef is designed to evolve the whole agent — model weights and the harness — then evaluate, version, and safely deploy those updates back into serving. Really excited to finally share Reef we’ve been building toward continual self-improvement! Come and check it out: And join the Discord group for more updates: