Steve • Plus(@steveDOTplus):Noah on RSI panic: we already don't get AI behavior. More AI-written code doesn't change that you can still read and study it. #AI

2026.09.20 15:41

Noah on RSI panic: we already don't get AI behavior. More AI-written code doesn't change that you can still read and study it. #AI#

Noah Giansiracusa@ProfNoahGian

2026.09.20 15:21

I don't see why so many people seem to think that RSI means we won't understand AI anymore. (1) we already don't understand the behavior of AIs despite knowing how they're designed, and (2) even with RSI, an AI model is a piece of software written in a programming language, and we can use LLMs to help explain the code to us, that's something it's really good it. RSI could certainly lead to faster hyperparameter optimization, perhaps even major design innovations, more efficient learning paradigms, etc., but we can still pay attention and study the code the AIs are writing, just as we do now--I don't see that changing whether AI writes 0% or 80% or 100% of the code. Am I missing something here?