jianlin.su
@Jianlin_S
Grad&Clip&EM is all you need @Kimi_Moonshot
Blog: , Cool Papers:
Interesting link:
加入 February 2025
21 正在关注 11.6K 粉丝
Steepest Descent on Manifolds: 6. Muon + Double Rotation
Introduces MuonR — a Muon variant that constrains updates to left & right rotation matrices. This preserves the singular value distribution of weights, providing a clean, elegant way to maintain training stability.
显示更多
