Proud to share MERA: joint work from a group of brilliant researchers including our very own.
It evolves small models with SkillBook + routing + adapters so they take on more of the agent workload over time.
Paper + code 👇
🚀 MERA: Model Evolution and Routing with Skill Adaptation for Agentic Systems at Scale
How can we make small models stronger for on-device agent deployment?
MERA uses stronger models to guide an iterative loop of RL/GRPO, skill learning, and router optimization. Student failures become verified demonstrations, reusable SkillBook procedures, and LoRA updates, helping the small model take on more work over time.
🔥 Results:
Qwen2.5-Coder-1.5B: 28.7% → 49.7% coding pass
Qwen3.5-2B on TAU-2: 14/35 → 18/35
Fine-tuned 2B matches an unadapted 4B model
Don’t just route around small models. Evolve them.
📄
💻