Helpful list of all the recent rogue AI incidents from the WSJ.
It's getting hard to track them and will only get worse.
We like need to establish consistent naming or numbering conventions, e.g. OpenAI-May11June26-Collusion.
I'm not afraid to criticise OpenAI when it does bad things so I should also praise them for good:
1. They've been very candid about Astra's bad and declining monitorability and how deeply troubling that is. (They're promising to release research on the causes and try to find mitigations, TBD.)
2. Today's "framework for reporting model misalignment" is on paper the best thing of its type to my knowledge. Hopefully other companies copy. (Of course we need to make sure they fully follow through.)
3. AFAIK the company has done nothing to censor staff talking candidly about x-risk lately. (A strong contrast with DeepMind in the past which strongly policed what staff could say in a way that was likely very harmful.) 1/
I'm old enough to remember when Scott Aaronson was super skeptical AI was a big deal, coming soon, or would kill everyone:
The Age of Wonders and Terrors
(At the end has advice on how math people who agree can help the situation.)
On here it can feel like the ratio of people who want AI to go slower, vs people who want it to go faster is 1:1.
But in the broader world the ratio is an eyewatering 34:1.
More Americans think the US is secretly run by lizard people than think AI is advancing too slowly.
The Financial Times editorial board comes out strong for an AI pause.
Not just 'pacing the frontier' - "pause development of the most advanced frontier models until the risks can be understood and contained."
The Marginal Revolution comments section has lost patience with Tyler Cowen's commentary on AI to a degree that's actually laugh out loud hilarious.
Here are the top comments on : "Act like it is science". 1/