greg brockman says “we’re now in the AGI era.” one of the most interesting things about this conversation with
@bhorowitz and
@eriktorenberg is how long he’s been thinking about when that would happen.
at the beginning of the pod,
@gdb recalls doing some math on compute with ilya around 2016/2017. following the trajectory of moore’s law, they thought agi might be about 15 years away. if you were willing to build enormous supercomputers and spend hundreds of billions of dollars, maybe you could get there in 10. the accelerated scenario they were envisioning a decade ago is roughly the one we’re living through now.
the faster timeline depended on people deciding to build an enormous amount of infrastructure. greg describes the present moment as a lot of long-running forces coming together: “it kind of makes sense it’s happening now.”
im the kind of person who resists the idea that it’s possible to predict the future, but if you were reading the right research papers 10 years ago, there were a lot of things you could extrapolate out and be roughly right about a decade later. brockman remembers openai discussing agents that could use a screen, keyboard, and mouse at an offsite in napa in 2015. he also points back to 2017/2018-era ideas for how humans might supervise systems that are smarter than they are. put differently, people were thinking about app-layer innovations like computer-use, and ai safety long before capabilities existed.
greg now thinks astra is reasonably described as agi, while acknowledging that its abilities remain uneven. in a recent essay of his titled “the defenders window” he describes safety requirements during training and evaluation, and getting powerful defensive tools into the hands of organizations before comparable capabilities spread to attackers (there is now a $ 1bn fund for this, seeded by oai).
a personal illustration of this is his own website. after the hugging face incident, greg asked an agent to check his simple blog and got back 13 security vuln findings. then it went into his cloudflare dashboard, changed settings, migrated the site, checked its work, and scheduled a follow-up to finish the email protections. there was still a bunch of ordinary preparation to do on the personal website of someone who had spent a decade thinking about agi.
which is kind of funny. you can have a pretty good sense of when the technology/agi will arrive and still have an enormous amount of work to do to get the world ready for it. greg’s account brings those two timescales together: the decade spent building toward this moment, and the relatively shorter window to act on what is now possible.