the reason you will have to care about heterogenous compute is that as we get closer to RSI you will be just priced out of accessing the leading edge chips by the labs; there is no upper cap on the demand here
$1B makes sense. 70% on training is logical
> DeepSeek is using NVIDIA gaming GPUs to run inference on smaller models
this is news to me but tbh is an obvious move. Imagine how much work you could speed up just with Jev-style small models, or a custom-made Qwen 35Bโฆ
I want it