๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Joe Benton
@JoeJBenton
Soon joining @METR_Evals | Previously Alignment at Anthropic, PhD at University of Oxford
๊ฐ€์ž… February 2017
63 ํŒ”๋กœ์ž‰ ์ค‘    13.1K ํŒฌ
๐Ÿ“„ As AI systems get increasingly powerful, it might be very important that they can help with key tasks like AI safety research. I think TASTE, this eval which @hasanbaig8 painstakingly built, may be one of the best signals of whether we're on track for our AIs to be helpful.
๋” ๋ณด๊ธฐ
As we increasingly automate AI R&D, can we also automate AI Safety research? We built TASTE (The AI Safety Taste Evaluation), a benchmark to measure whether models can predict which research proposals experienced AI safety researchers prefer.
๋” ๋ณด๊ธฐ