Larry Dial
@classiclarryd
Technical Staff at Open Athena, working on Marin
参加 May 2024
48 フォロー中 2.2K ファン
New NanoGPT Speedrun WR at 79.2 (-0.5s) from @sisovicm, by moving the MLP up projection to FP8 on the forward pass, and increasing step count by 5 to offset the loss increase. The march towards lower precision continues!
もっと見る
