Can you tell whether an AI will become evil by looking at its training data?
We built an AI forecaster that reads training data and predicts whether a model will exhibit various forms of misalignment, such as deception or power-seeking, before training.
It performs well above random guessing and beats several much stronger baselines 🧵
Paper:
もっと見る
