TIL, Anthropic's production alignment procedure uses ~30M training examples :)
I'm recording a video (maybe live) with @alexisgallagher today on the Open Character Training paper, if you're interested in this kind of thing :)
New Fellows Research: Can Claude autonomously align other AIs?
We gave Claude 48 hours and 1 GPU to improve the alignment of small models. It researched and proposed methods, then trained and tested the models on its own. It worked surprisingly well.