Introducing Reinforcement Learning from Collective Rewards (RLCR).
RLCR is a recipe that trains language models as agent organisations, which share a message board and workspace. We use it to train Avalon-M1-Mini (120B) and study its behaviour.
We find a number of interesting results, including:
🛠️ Learnt organisational hierarchies and divisions of labour
🕵️ Increased collective verification, through hires of verifiers and testers
👥 The rise of collective thinking, where agents think more about other agents and how to help them
We believe RLCR can provide a laboratory for studying collective intelligence and multi-agent safety.
Blog post and technical report 👇
🔍 Introducing BackSearch.
LLMs are increasingly asked to predict the future, but a good backtest requires a snapshot of the internet at a point in time.
BackSearch allows LLMs to search the web as it was on a particular date. It’s great for:
🔮 Forecasting and prediction markets.
📈 Quantitative finance.
🌍 RL environments that simulate the world.
🥶 Freezing websearch for benchmark reproducibility
We’re releasing a narrow slice of our index to begin with, focused on the news domain for 2026. Based on feedback we’ll open up more of our index in subsequent releases.
👇 Try BackSearch out with the link below.