ALERT🚨: NVIDIA has been working overtime, nights, and weekends after being shocked 🤯 by last week’s TPUv7 FP8 submission showing better performance per dollar. Unfortunately for NVIDIA, its first GB300 FP4 counter-submission is still 1.64x worse in performance per dollar than TPUv7 for external customers across most of the end-to-end performance curve. The x-axis of the graph below uses end-to-end latency, so a higher curve is better. The TPUv7 curve has higher perf per $ across most of the E2EL Pareto frontier. This initial submission looks like NVIDIA’s first attempt to close the gap, but the gap is still massive. We expect more counter-submissions from NVIDIA as they continue trying to narrow the difference.