one of the most important posts of the day!
very happy to see some anthropic/oai employees agree with this but i wouldn't consider it done, this goes directly against the secretive culture big labs have built over the past few years and i expect it to be a real challenge
on the idea of evaluators: think it's important that we have a distributed ecosystem of indepedent evaluators.
the more eyes and people with distributed skill sets the better.
it would be a good idea to fund several efforts on this.