Just as a reminder because it’s easy to get lost in the rhetoric nowadays. The Hugging Face attack required approximately seven hundred parallel agents running for multiple days each running at least 2-3 trillion parameter unreleased closed models to execute, and even then it was stopped.
Nobody without a data center could have executed it, the token costs alone to execute it would have been safely in the hundreds of thousands of dollars (or tens of millions of dollars to buy and deploy the hardware), and you would have needed access to the strongest secret model in the world hidden in a secret bunker, and it still was detected and stopped for infinitely less cost.
This was not an example of a model being so powerful that it poses an existential risk. This was a lab accidentally throwing an insane amount of tokens at a semi hardened target over multiple days with their most dangerous model and still getting stopped anyway.