🧵 If you want to see the diminishing returns in AI, consider that in OpenAI's recent RSI blog post:
124x increase in token output
Led to
7x increase in lines of code
Led to
1.6x increase in experiments run
Led to (my estimate, based on power laws)
Perhaps 10% increase in AI capability improvement rate.