TPU 8i and TPU 8t deliver sustainable economics—offering up to 80% better performance-per-dollar for low-latency serving while seamlessly scaling to 1M+ chips! Learn how our 8th-generation TPU system drives the next frontier of AI ↓

TPU 8 will be a massive leap forward in energy efficiency—with up to 2x better PPW than Ironwood. But for us, sustainability isn’t about waiting for the next best chip; it’s a daily effort to make our entire production fleet more efficient → #8daysofTPU8#

tpuf quantizes vectors to improve perf (RaBitQ) the algo randomly rotates vectors, and we were using matmul at O(d²) space & time, brutal at high dims. 10k = 400MB in RAM! we rebuilt the rotation using FWHT at O(d) space & O(d log d) time. ~no recall loss, 10k = only 5kB in RAM

Discover how TPU 8t reduces training timelines from months to weeks, and how TPU 8i breaks the "memory wall" to power the low-latency inference required for next-gen AI agents to perceive, reason, and act →

Google and MediaTek Deepen TPU v9 Collaboration with Upgraded Triggerfish, Targeting AI Agents, Reinforcement Learning, and Effective Compute Maximization 1. My latest industry checks indicate that Google is developing an upgraded v9 chip, likely codenamed Triggerfish, based on TPU v9 / Humufish, with MediaTek exclusively securing this new, higher-priced order. 2. This upgraded chip is a Humufish-based follow-on program, positioned as a v9 variant with stronger inference capabilities that can help mitigate both the CPU wall and the memory wall. The project also further confirms MediaTek as Google’s preferred development partner for the TPU v9 generation. 3. The key differences between this v9 variant and Humufish are: SRAM capacity is significantly increased to 2–3 times that of Humufish, a new simulation die is added, and memory is upgraded to HBM4E, versus HBM4 on Humufish. 4. Beyond local TPU management and training / inference mode switching, the newly added simulation die's likely role centers on reinforcement learning (RL) and AI-agent coordination. 5. The larger SRAM keeps more of the active working set required by RL and AI agents local to the TPU, reducing data-movement costs and improving efficiency in the ultra-low-latency decode stage. 6. With Humufish lifetime shipments still estimated at 4–5 million units, Google is adding an incremental Triggerfish order of 1–2 million units, with production expected to begin in late 2027 and ramp in volume in 2028. As Triggerfish carries a unit price roughly 30% higher than Humufish, it could become an incremental driver of MediaTek’s 2028 business momentum.