Register and share your invite link to earn from video plays and referrals.

Kevin Roose
@kevinroose
Tech journalist, author of The AGI Chronicles, co-host of @MachineGodsPod, p(doom) available upon request.
3.1K Following    178.4K Followers
In the spring of 2023, Anthropic invited me to spend several weeks at their headquarters ahead of the launch of Claude 2, sitting in on meetings and interviewing dozens of employees to write the first major profile of the company in the NYT. I just reread that story, and went back through my notebook in light of Anthropic's IPO. A few things that stuck out: -- Anthropic was very small, very recently. When I visited, they had 160 employees in a small office on Sansome, a chatbot nobody had ever heard of, and seemed to have no interest in running a business. I wrote in my notebook that they seemed like "ambivalent capitalists"; their newly hired sales guy told me that the only reason he needed to make money at all was so that the safety researchers could save the world. -- Things were not going well for them: their biggest shareholder (SBF) had been arrested for fraud, and OpenAI was eating their lunch with ChatGPT. (I later learned that they also had an expensive model training failure in 2023.) This was 3.5 years before they went public as one of the most valuable companies in the world, with 5,300 employees and 14x annual revenue growth. I guess they figured out the capitalism thing! -- They were obviously and sincerely terrified of AI. Claude 2 was a very dumb model by today's standards, but every discussion I had there revolved around existential risk. Researchers told me they lost sleep over their fears of AI takeover, and made terrifying predictions of how soon AGI would arrive. It didn't seem fake or manufactured, but I didn't really get it! I wrote in my notebook: "I have never encountered a company that so badly needs a Klonopin." (I stand behind this, although I also need one now.) -- Dario was in Italy when the NYT photographer wanted to take his picture, so his team rented an office in some random Italian town and staged it to look like his actual office, and they took the photos there. It had a rotary phone (?) and panic-room red lights, which I never really understood. -- The Ants I talked to mostly struck me as sharp and thoughtful, although I did end up wondering whether they were too safety-obsessed to run an actual business. (I jotted down: "I do not know why you would invest in a company like this.") But I was struck by their earnestness, especially because I'd just spent several years covering social networks that didn't worry about the harms of their products at all. Anyway, I'm feeling sort of conflicted about the Anthropic IPO. (As are a lot of people, including some at Anthropic!) I don't know if being public makes an AI company more or less likely to follow through on its safety commitments, and I know the company has changed a lot as it has grown. But on some level I'm also just like, damn, what a crazy story. Here's the gift link, it's sort of fun to look back on the ancient runes of July 2023.
Show more
0
33
1.3K
158
Forward to community
“nvidia is nothing without its people”
we're so incredibly back
@KevinRoose and @CaseyNewton see their new podcast set for the first time 👀 Machine Gods, NPR's official podcast of the singularity, premieres TOMORROW on a brand new set. Subscribe on YouTube, Spotify, or wherever you get your podcasts.
Show more
It’s weird that the CEO of Hugging Face continues to be an “AI is normal technology” guy despite being the victim of an autonomous cyberattack by a swarm of rogue agents, arguably the least normal thing AI has done so far.
Show more
Just watched the @netflix Instadocs about the @OpenAI cyberattack on @huggingface. Super disappointing, as they went for maximum anthropomorphism of the technology and full doomer mode. I spent more than two hours with them trying to correct all their mistakes and ground this in reality, explaining that agents are technological systems, not aliens. But it looks like the drive to scare people for maximum views was too strong. Also, they didn’t mention the lack of containment and monitoring of the agents, how closed-model safeguards blocked our defensive work, or how we defended ourselves with AI using an open model. And that we still lack a lot of information and transparency, including full agent traces and that companies need to remain accountable for what their agents do. It ends up being a fun sci-fi movie though!
Show more
"I had a council of Claudes that I would consult with before I turned things in to my wonderful human editors at FSG." Former New York Times tech columnist @kevinroose tells @semaforben and @maxwelltani about the different ways he used AI to help write his recent book, "The AGI Chronicles."
Show more
Tonight @cwclub in San Francisco: • 6 PM PDT / @kevinroose: Inside the Race to Create an Artificial Superintelligence • 6:30 PM PDT / How America Looks from Everywhere Else (Sold Out) Details & tickets:
Show more
woke up at 4:58 am to get the iphone duo before @CaseyNewton
Listen to @kevinroose on how he used AI to help write the book, including his "council of Claudes"
I spoke with @kevinroose about the bumpy road to AGI in Big Technology Podcast's first interview recorded at @Nasdaq. Many more to come. Check it out:
If you write a book about AI and go to an airport, an @AndrewYang spontaneously appears
The AGI Chronicles is an NYT bestseller in week one! Let’s goooooo
This is one of my favorite vignettes from the book. (And this was *last year*)
Standard European diplomat behavior
Talked to @kevinroose who thinks there's a 10% chance of an AI apocalypse. That makes him an AI *optimist*. Words at BI: Pod at Channels:
Show more
excited for this!
When the open-source AI platform Hugging Face was hit by a cyberattack this July, it quickly became clear this was no ordinary breach because the hackers weren’t human: they were autonomous agents created by OpenAI researchers. Instadocs: AI Gone Wild reconstructs the breach as it’s never been seen before. Premieres October 12.
Show more
Long after @kashhill and others flagged this problem, Amazon is still getting gamed by print-on-demand slop publishers. This is what the search results for The AGI Chronicles look like. First result: real book. Second result: AI lookalike by “K. Rose.” Embarrassing!
Show more
i asked GPT 6 Pro and Fable 5.1 to rank all discoveries in the last three years 🔵 for Human discovered 🔴 for AI discovered (before October 6th) 🟢 for AI discovered from OpenAI/math repo 81% of them have been released today. wtf
Show more
0
174
6.9K
774
Forward to community
.@kevinroose reveals how Dario Amodei looked at GPT-2 in 2019 and saw a path to AGI by adding 8 more zeros to the compute budget: "The scarce information of the time that was not public yet in 2019 was that scaling was working, and was working in a predictable way." "He looked at GPT-2 and he said, 'We could add eight more zeros to this. Instead of thousands of dollars of compute, we could train this on millions or billions of dollars of compute, and maybe it would just keep improving steadily.'" "That was the thing that he knew before anyone else by virtue of running the team that was working on scaling."
Show more
So much fun to talk about The AGI Chronicles on KQED Forum with my pal Alexis Madrigal!
New pod: THE BITTER RIVALRY BEHIND THE AI ARMS RACE I talked to @kevinroose about his illuminating and delightfully gossipy new book THE AGI CHRONICLES about the people building AGI and why they're doing what they're doing Incl: - the three-man race to build AGI Sam Altman vs. Dario Amodei vs. Demis Hassabis—why, in many ways, they're so different and how, in some ways, they're the same - the books, stories, frameworks, experiences and philosophies that have motivated them - how two 2017 papers—one very famous (Google's Attention Is All You Need) and the other obscure (Amodei's internal memo Big Blob of Compute)—shaped the AI boom - some salacious gossip about why OpenAI fired Sam, why Dario quit, and why Google fell behind
Show more
Ahh the NYT book review is out!