jianlin.su
@Jianlin_S
Grad&Clip&EM is all you need @Kimi_Moonshot
Blog: , Cool Papers:
Interesting link:
가입 February 2025
21 팔로잉 중 11.6K 팬
Steepest Descent on Manifolds: 6. Muon + Double Rotation
Introduces MuonR — a Muon variant that constrains updates to left & right rotation matrices. This preserves the singular value distribution of weights, providing a clean, elegant way to maintain training stability.
더 보기
