註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Gradient
@Gradient_HQ
Open infrastructure for open intelligence. Lattica · Parallax · Echo
加入 May 2024
76 正在關注    689.8K 粉絲
Proud to share MERA: joint work from a group of brilliant researchers including our very own. It evolves small models with SkillBook + routing + adapters so they take on more of the agent workload over time. Paper + code 👇
顯示更多
🚀 MERA: Model Evolution and Routing with Skill Adaptation for Agentic Systems at Scale How can we make small models stronger for on-device agent deployment? MERA uses stronger models to guide an iterative loop of RL/GRPO, skill learning, and router optimization. Student failures become verified demonstrations, reusable SkillBook procedures, and LoRA updates, helping the small model take on more work over time. 🔥 Results: Qwen2.5-Coder-1.5B: 28.7% → 49.7% coding pass Qwen3.5-2B on TAU-2: 14/35 → 18/35 Fine-tuned 2B matches an unadapted 4B model Don’t just route around small models. Evolve them. 📄 💻
顯示更多
0
72
216
107
轉發到社區