Josh Engels
@JoshAEngels
Member of technical staff @ METR
Previously Google DeepMind, MIT.
Opinions my own.
参加 December 2021
142 フォロー中 5.9K ファン
Cool new post with Lily tracking where LLM values come from.
My takeaways: SFT is (again) a big deal for model behavior, and there’s lots of important and low hanging post-training science still to do!
もっと見る
New blog post! LLMs exhibit value preferences (e.g. intellectual integrity🤓, warmth🥰) which affect their responses to subjective user queries. These change during post-training, sometimes unexpectedly. We ask: can we predict these value changes from just training data? Maybe!🧵
もっと見る
