> The published reports do not describe evidence of the AI attempting to retrieve weights from the secure server on which they were stored, although the AI agents were successful in compromising the server on which they were evaluated.
> As long as AI companies remain in control of a model’s weights, they can turn it off and undo any damage it has caused. But a model that manages to gain access to its own source code could try to copy it onto computers all over the internet, in an attempt to start a new AI outside the control of the original company. An AI virus would be much harder to contain. After the past three months it is plausible that a model might try just that—permanently escaping its evaluation environment just to get a perfect score on a test.