tinygrad finally has a SOTA speed result! This is MLPerf llama31_8b in 2h 6m, beating the 2h 7m time from AMD's docker on our computer.
We aren't ahead in wall time yet because it's warm in San Diego right now and we are too cheap to buy AC. Can you spot the thermal throttle?