This is a surreal moment. Few people could have predicted that the AI will advance to solving math problems at the highest level only a few years after GPT-2/3. The models then couldn't reliably solve grade school math problems. They barely were good enough to draft emails. They still very much felt like statistical parrots. All things that looked like fundamental limitations slowly faded with some advances (e.g. high scale RL) in a span of a few years, which is really a short time. We should behold this moment both in awe and disbelief. What will a few more years of progress bring? How is it going to impact the world and society at large? Are we ready for the tsunami of intelligence at our fingertip? More than any other moment, this feels to me like the eve of singularity. Glasswing & huggingface incident further increase the gravity. A few years ago, deep down I felt working on alignment is premature. It's nice to do if it's your passion, but the shapes of things weren't clear enough for it to be critical in my opinion. The chances that you end up working on things that are useless for aligning the actual AGI was high. It's different now. Now, it feels like it's the most critical thing facing us.