I’m increasingly worried about misalignment that subverts training itself. Following our ICML work on exploration hacking, we study what makes training setups vulnerable, starting with AI debate.
Two posts w/ Jason Brown,
@BraunJoschka, Roland Zimmermann &
@davlindner
Links 👇