Keller Jordan
@kellerjordan0
CIFAR-10 fanatic
Pretraining @OpenAI OpCo LLC.
参加 March 2016
428 フォロー中 16.9K ファン
New modded-NanoGPT optimization benchmark result: @wen_kaiyue has improved upon both the Muon and AdamW baselines, by replacing their weight decay with hyperball optimization. The new record is 3325 steps.
もっと見る
