Really excited to finally share ThunderSyncRL ⚡, a project I co-led with
@seilk_!
We show that synchronous agentic RL can be up to 1.9× faster without sacrificing on-policy updates, simply by overlapping gradient computation with rollouts.
Huge thanks to
@Azaliamirh and the entire team!