to be fair this is from a game on the arena where lying is advantageous, the best interpretation is:
“when in an environment where lying is advantageous to them, these are the models that lie the most”
we’re currently doing an eval where we explicitly measure lying when they’re told not to in more complex simulations, early result rankings aren’t too dissimilar but that gap isn’t as big so far
i think it is interesting to read the different interpretations of this that people have and whether we want models that lie to their own benefit like this, will leave that up to safety teams to opine on i guess :p
もっと見る
