๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Bingxiang He
@HBX_hbx
Third Year PhD Candidate @TsinghuaNLP
๊ฐ€์ž… August 2022
237 ํŒ”๋กœ์ž‰ ์ค‘    457 ํŒฌ
Introducing JustRL II ๐Ÿš€ Building on JustRL ( we took a closer look at how GRPO behaves in long-CoT RL (128k). The group-mean baseline is a great fit for short traces, but over tens of thousands of tokens it gives a coarse, response-level signal. JustRL II keeps GRPO's group structure and adds a critic for token-level credit assignment. Just as simple, keeps improving where GRPO levels off: AIME25 61โ†’81 on a 2B model. The same recipe powers the RL stage of MiniCPM5-2B ( making it SOTA among models under 4B. Data + checkpoints are open. Code lands this week. ๐Ÿ“–
๋” ๋ณด๊ธฐ