Deli Chen(@victor207755822):Just my opinion: The real reason PPO can handle long-horizon tasks? The Value Model for multi-step task. Honestly, it just shifts the training difficulty from GRPO’s GRM onto the Value Model. I mean, the problem isn’t solved — it’s just been relocated. The core question remains: How do you get stable process supervision in long-horizon tasks? That’s the real bottleneck.

Deli Chen

@victor207755822

加入 December 2023

181 正在關注 31.7K 粉絲

Deli Chen@victor207755822

2026.06.17 16:56

Just my opinion: The real reason PPO can handle long-horizon tasks? The Value Model for multi-step task. Honestly, it just shifts the training difficulty from GRPO’s GRM onto the Value Model. I mean, the problem isn’t solved — it’s just been relocated. The core question remains: How do you get stable process supervision in long-horizon tasks? That’s the real bottleneck.

165

轉發到社區

熱門用戶