In our new paper, we demonstrate that you can achieve selective generalisation of misalignment by midtraining on synthetic documents that describe how AIs can be misaligned in a special mode marked by a new token (a neologism), but remain aligned outside this mode.
Paper:
LessWrong post: