๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Nathalie Kirch
@n_lie_k
AI Safety Researcher @GeodesResearch
๊ฐ€์ž… December 2023
278 ํŒ”๋กœ์ž‰ ์ค‘    165 ํŒฌ
Iโ€™m increasingly worried about misalignment that subverts training itself. Following our ICML work on exploration hacking, we study what makes training setups vulnerable, starting with AI debate. Two posts w/ Jason Brown, @BraunJoschka, Roland Zimmermann & @davlindner Links ๐Ÿ‘‡
๋” ๋ณด๊ธฐ