Pedro Marques ⚙︎
@pmarquees
RL and Evals
💻
🏔️
🚵
🧑🍳
Joined April 2009
1.8K Following 3.5K Followers
Lots of fun new approaches on RL and post training on the timeline today
New research: We developed JOLT, a post-training method where one model acts as both teacher and student, with the teacher trained to give feedback the student can use.
On MATH, it matched GRPO's accuracy with 6.5x fewer training tokens.
Show more
