AVERI standards director
@prpaskov says the "only 50 AI evaluators" narrative is misleading because it ignores an entire hidden pool of auditors, cyber experts, and NDA-bound teams already doing the work:
"When people are giving this 50 evaluators number, they're largely focusing on the evaluation of the model or the system level. At AVERI, we think of it in three parts. You can audit the model or the system, you can audit compute, and you can audit governance."
"A lot of frontier evaluations to date have been done under NDAs. So there are more even on the model and system level than are visible."
"The skillsets of traditional auditors like the Big Four, KPMG, EY, there are a lot of skillsets in governance auditing and risk management auditing that we can pull from. In the cybersecurity world, tons of skillsets."
"There is actually a lot of talent out there. We just need to do a better job at funneling it."
@AVERIorg