Register and share your invite link to earn from video plays and referrals.

Jason Wolfe
@w01fe
alignment and the model spec @OpenAI (opinions are my own)
Joined May 2010
826 Following    5.9K Followers
I agree with all of this emphatically, except I would qualify the superintelligence ban. Currently, to my knowledge nobody has any solid idea how to align or control superintelligemce, so I think something that amounts to a *temporary* ban until we do is a pretty good idea to the extent it could be reasonably and practically enforced worldwide. But of course that’s the rub. Someone might defect, and in the long run I doubt it’s possible to prevent superintelligence without halting (or maybe reverting, at this point) the progress of computing altogether or creating a draconian surveillance state (by default, at some point computers will get so good that a 4chan kid could do an intelligence explosion in their basement for the lulz). So a permanent ban likely seems impractical, and even if the science isn’t solved maybe at some point society would need to decide to go for it anyway despite the risk because it’s the least bad option.
Show more