OG of: P and T in ChatGPT, recursive self-improvement, neural distillation, GAN/World Model, deepest learning. Co-authored most-cited AI paper of 20th century
This is an old hat. That's exactly what the neural fast weight programmers did in the 1990s (including the 1991 unnormalised linear Transformer). Overview with links to the original papers: