Caleb Eom(@calebfoundry):High Bandwidth Flash (HBF) is a misunderstood AI hardware announcements right now. 3 TB/s NAND does not mean SSD that behaves like HBM, really the real trick is massive parallelism. Reads can approach HBM-like aggregate bandwidth. Writes are still NAND writes. And that distinction changes everything. As models continue to grow.. so is it better to solve this issue by continuing to use parallelism techniques at the Infrastructure layer? Certainly a thought worth having given Grok model is supposed to go more than 8T in size according to sources.

2026.08.21 15:22

High Bandwidth Flash (HBF) is a misunderstood AI hardware announcements right now. 3 TB/s NAND does not mean SSD that behaves like HBM, really the real trick is massive parallelism. Reads can approach HBM-like aggregate bandwidth. Writes are still NAND writes. And that distinction changes everything. As models continue to grow.. so is it better to solve this issue by continuing to use parallelism techniques at the Infrastructure layer? Certainly a thought worth having given Grok model is supposed to go more than 8T in size according to sources.