No one talks about how the DRAM density curve has basically…flattened.
Maxed-out Server 2021: 8TB Ram
Maxed-out Server 2026: …also 8TB Ram
That’s insane! A five-year stagnation. If your working set exceeds 8TB, tough luck!
Quite literally the only thing that’s going to get us exponential again is alternative tiers of memory. Specifically, ones that don’t rely on CPU memory controllers.
This is why I’m constantly rambling about CXL. Sure, there’s a latency cost, and a smart programmer will have to treat it differently.
…but are you not excited? We’re entering the heterogenous memory era (again)!
Imagine hundreds of terabytes of RAM on a single server! Absolutely insane to think about.