Another one! This is as good a time as any to say that there really should be a full independent investigation into these rogue AI incidents: --The METR/Redwood hugging face investigation was good, but it was only 3 people for 6 days. Let's increase those numbers by an OOM at least. --They were only allowed to look at data from a particular period leading up to the hack, and not the hacking that happened before or afterwards, including the much more concerning hacking of OpenAI infrastructure. The scope should be broadened to include all these incidents. --They had to rely on trusting both OpenAI and OpenAI's models: OpenAI gave them the data to analyze, and could easily have left some things out or doctored the data, and (perhaps even worse) they had to use OpenAI models to analyze the data and there is already evidence that said models might have been biased. --They didn't have the ability to run the models responsible, to do ablation studies. This is bad for science, because there are so many interesting experiments that could be done by re-running the same models in the same situations that happened during the incident and then making minor variations to find out what would have happened if circumstances were slightly different.