Dario created Anthropic out of concern that OpenAI wasn’t developing AI safely enough. We now have two tech giants in a breakneck race that neither seems to want to continue apace but neither seems willing to stop. Do you feel safer?
OpenAI was launched to safely usher in AGI. Yet before OpenAI, LLMs were mostly just a tool Google used behind the scenes to process search queries. Do you feel safer?
AI safety researchers like Paul Christiano developed alignment techniques like RLHF to control the behavior of LLMs, yet this is what made LLMs powerful and useful enough to go mainstream and usher in the age of generative AI we’re in now. Do you feel safer?
I believe all of these individuals/organizations were sincere in their attempt to make AI safer. But I also believe their efforts backfired spectacularly and made the world less safe. Am I wrong?
I fear that much of society’s efforts to make AI safe have succeeded well enough to make AI widely popular and extremely powerful yet failed to go the extra mile needed to make it actually safe--thus arguably putting us more at risk, not less. And I fear this pattern shows no sign of abating.