Larry Dial
@classiclarryd
Technical Staff at Open Athena, working on Marin
加入 May 2024
48 正在关注 2.2K 粉丝
New NanoGPT Speedrun WR at 79.2 (-0.5s) from @sisovicm, by moving the MLP up projection to FP8 on the forward pass, and increasing step count by 5 to offset the loss increase. The march towards lower precision continues!
显示更多
