๐ As AI systems get increasingly powerful, it might be very important that they can help with key tasks like AI safety research.
I think TASTE, this eval which
@hasanbaig8 painstakingly built, may be one of the best signals of whether we're on track for our AIs to be helpful.
As we increasingly automate AI R&D, can we also automate AI Safety research?
We built TASTE (The AI Safety Taste Evaluation), a benchmark to measure whether models can predict which research proposals experienced AI safety researchers prefer.
๋ ๋ณด๊ธฐ