Deli Chen
@victor207755822
Deep Learning Researcher @deepseek_ai | #AGIforEveryone#
Prev. BS and MS @PKU1898 | |
All opinions are my own. | INTP-T | 人心惟危，道心惟微
가입 December 2023
181 팔로잉 중 31.7K 팬
Just my opinion:
The real reason PPO can handle long-horizon tasks?
The Value Model for multi-step task.
Honestly, it just shifts the training difficulty from GRPO’s GRM onto the Value Model.
I mean, the problem isn’t solved — it’s just been relocated.
The core question remains:
How do you get stable process supervision in long-horizon tasks? That’s the real bottleneck.
더 보기
