OPENAI HAS LARGELY AUTOMATED TRAINING OF NEW EXPERIMENTAL AI MODELS
OpenAI’s internal AI models can now handle much of the process of building and training experimental models, including writing GPU kernels and optimizing the code used to run them.
Researchers can reportedly give an AI a single example of the optimization they want, then let it work for weeks implementing and testing similar improvements.
OpenAI employees also say internal agents increasingly collaborate with each other to solve problems without involving their human users.
The capability has improved significantly in just the last few months, while OpenAI’s growing access to compute is allowing researchers to test ideas much faster. Employees said some experiments that previously could have taken years can now be carried out in about a week.
Source: The Information