People keep asking me: what's different about optimization in RL?
Seemingly nothing โ the pre-training stack just works (Adam, even SGD ๐
@saagnikkk).
Bringing some answers from my last work (sorry for the delay โ been cooking ๐).
We introduce ISO: Isospectral Optimization: an RLVR-native optimization stack.
Built on one simple observation, spectral inheritance: RLVR can reuse the base model's spectrum and acquire new behavior purely through the singular frames.
๐งฉ Offline: ISO-Merger โ consolidates RL experts into one model with no data, no rollouts, no OPD. Checkpoints only.
โ๏ธ Online: ISO-Optimizer โ a drop-in wrapper on AdamW / Muon that matches AdamW's accuracy with ~2.7ร fewer steps on Qwen3-8B-Base.
๐
๐
๐งต๐