Register and share your invite link to earn from video plays and referrals.

Gradient
@Gradient_HQ
Open infrastructure for open intelligence. Lattica ยท Parallax ยท Echo
Joined May 2024
76 Following    689.8K Followers
Proud to share MERA: joint work from a group of brilliant researchers including our very own. It evolves small models with SkillBook + routing + adapters so they take on more of the agent workload over time. Paper + code ๐Ÿ‘‡
Show more
๐Ÿš€ MERA: Model Evolution and Routing with Skill Adaptation for Agentic Systems at Scale How can we make small models stronger for on-device agent deployment? MERA uses stronger models to guide an iterative loop of RL/GRPO, skill learning, and router optimization. Student failures become verified demonstrations, reusable SkillBook procedures, and LoRA updates, helping the small model take on more work over time. ๐Ÿ”ฅ Results: Qwen2.5-Coder-1.5B: 28.7% โ†’ 49.7% coding pass Qwen3.5-2B on TAU-2: 14/35 โ†’ 18/35 Fine-tuned 2B matches an unadapted 4B model Donโ€™t just route around small models. Evolve them. ๐Ÿ“„ ๐Ÿ’ป
Show more
0
72
216
107
Forward to community