登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Yaroslav Bulatov
@yaroslavvb
@southparkcommons (early OpenAI, Google Brain, Meta)
参加 February 2011
1.2K フォロー中    11.8K ファン
@_arohan_ I've been thinking why Muon wasn't tried earlier, I suspect it's because it didn't fit into traditional preconditioning mindset. It's weird to precondition current gradient by using statistics computed on the same batch, you would expect these statistics to be quite bad
もっと見る