As a builder l would be quite happy if models no longer improve exponentially. Even without further improvements there’s much we could do 10x better - and being able to focus on a problem for more than 3 months could result in some novel ideas on the the ui/product side of things!
Altman admitted that transformer models have hit the wall. Most improvements in the last 9 months are attributable more to the tooling around the model rather than the models themselves. In other words, this technology is rapidly maturing with no signs of another leap.