Register and share your invite link to earn from video plays and referrals.

Search results for muon
muon community
One keyword maps to one global community path.
Create community
People
Not Found
Tweets including muon
.@MuonSpace is turning space infrastructure from bespoke projects into a production system. Eclipse is proud to lead the company’s $250M Series C as it builds the infrastructure layer for the industrialization of space. More on why we invested from Eclipse Partner and Head of Growth Joe Fath:
Show more
They also use Muon throughout the network - Router AdamW for stability - GR projections AdamW (suspected due to their weird shape) - ngram table Adam without weight decay - per head orthogornalization They trained the model with TP so for the parameter update, they come up with a parameter assigner to balance flops across ranks. The ranks then exchange via all to all
Show more
Why Does KellerJordan's Muon Have an Extra max(1, ⋅) Compared to MuP ?
GDN-2 scales nicely with Muon 🚀 We trained hybrid MoE models at three scales (2B-7B) with Muon. GDN-2 matches Mamba2's loss with ~10% less training compute!
SOAP, Muon, and Beyond: Pushing LLM Pretraining Scales Paper:
Steepest Descent on Manifolds: 6. Muon + Double Rotation Introduces MuonR — a Muon variant that constrains updates to left & right rotation matrices. This preserves the singular value distribution of weights, providing a clean, elegant way to maintain training stability.
Show more
🏐 Offensive Player of the Week | Sep. 14 🐶 Bianna Muoneke, @UGAVolleyball #SECVB# | presented by Allstate
They also share the early stage of their loss curve. We see that Muon on its own has very high gradnorms and residual activations
Want to explore global market opportunities directly on-chain? MUon, WDCon, STXon, and more are available via @OndoFinance Tokenized Securities to capture opportunities from AI infrastructure growth. Try Tokenized Securities with #Binance# and explore RWAs in a new way. #RWAsOnBinance# How to participate: 1️⃣ Try Tokenized Securities on Binance Wallet or Binance Alpha 2️⃣ Like, follow, repost, and share your feedback on trading Tokenized Securities in the comments 3️⃣ Submit your X post link and UID here: 🎁 15 winners will share 1,500 USDC worth of rewards for the most valuable feedback (ends on June 3 at 15:59 UTC)
Show more
0
132
322
132
Forward to community