Worth reading this tweet.
The challenge is who’s going to stop pursuing it?
America?
China?
Private companies?
Who?
This’ll be nuclear 2.0.
No country will trust the enemy to stop developing super intelligence.
It seems inevitable.
I resigned from Anthropic today. I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives. More thoughts below.