Larry Dial
@classiclarryd
Technical Staff at Open Athena, working on Marin
Joined May 2024
48 Following 2.2K Followers
New NanoGPT Speedrun WR at 79.2 (-0.5s) from @sisovicm, by moving the MLP up projection to FP8 on the forward pass, and increasing step count by 5 to offset the loss increase. The march towards lower precision continues!
Show more
