๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Fanqing
@FanqingMengAI
Co-founder of @Evolvent_AI, Previous: @Kimi_Moonshot (focus on rl infra) , Now focus on agentic benchmark & infra, contact: mengfanqing33@gmail.com
๊ฐ€์ž… March 2025
827 ํŒ”๋กœ์ž‰ ์ค‘    2.4K ํŒฌ
๐Ÿ’กOur view: RSI is a systems engineering problem, not just a model problem. Progress depends on the environment a research agent works in: what resources it can call, what it can change, and how it runs experiments. That environment should reflect real production workflows and be easy for agents to use. At @Evolvent_AI, we built RSIGym around Everything as a Service. Agents can call established research services and iterate on data, training settings, and harness code. We also introduce RSI-Index to measure how well frontier agents jointly improve a target modelโ€™s weights and harness. Across 6 research agents and 5 benchmarks, Opus 5 leads at 0.4809. ๐Ÿงต Weโ€™re releasing the code, experiment configurations, research trajectories, and evaluation logs. Try your own improvement methods with RSIGym. ๐ŸŒ Website: ๐Ÿ’ป GitHub: ๐Ÿ“„ arXiv:
๋” ๋ณด๊ธฐ