登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

思维怪怪
@0xLogicrw
写关于 AI 的一切 Shit Post @BeatingOfficial AI 信息流:
参加 May 2018
2.7K フォロー中    7.7K ファン
这几天,Anthropic 推荐的第三方评估机构 METR 接连遭到质疑。外界发现,它的不少核心成员和 Anthropic、OpenAI 等 AI 公司关系密切。METR 自己也承认,此前一次评估中至少 6 名参与者与 AI 公司员工有密切私人关系,当时甚至还没有正式的利益冲突政策。 METR 总裁 Chris Painter 现在正面回应。他称 METR 靠捐款运营,从未接受前沿 AI 公司及其员工的钱,给 Anthropic、OpenAI 等公司做评估也不收费。这些公司会免费开放模型和 Token,让 METR 做测试。 Painter 强调,METR 的目标不是替 AI 公司证明模型「安全」,而是在发现模型可能失控时,把证据公开给政府和公众。
もっと見る
My name is Chris Painter, and I'm the President of METR (Model Evaluation and Threat Research). I know we've made a lot of new friends on the internet the last couple of days, so I thought I'd take this chance to re-up what we do and why. Our work is aimed at making sure that if AI really were autonomous, difficult to steer, and close to "going rogue," the public would find out. If evidence exists inside of an AI company that it’s close to losing control of AI, we want to make sure that information gets shared with the rest of the world, including governments and the public outside the company’s walls. This is what we've been focused on since 2022, and over the years we've worked with OpenAI, Anthropic, Google DeepMind, Meta, Amazon, and others on piloting third-party assessments and investigations of this type. We don’t have some private room where we rubber stamp things as “safe” or not. We have had a track record of publishing results on AI that don't cleanly map onto the "doomer" or "accelerationist" labels, and we put in effort to hire people with competing views on AI. We’ve been cited for having found some of the strongest evidence that AI capabilities are improving rapidly (our work measuring AI “time horizons”) while also presenting some of the strongest evidence that, at various points, AI’s capability may be overstated (some might remember our study showing that early 2025 software engineers were actually being slowed when they thought they were being sped up). METR is funded by donations. We don't accept money from frontier AI companies. They haven't paid us for our work, and we don't accept donations from them or their employees. As we’ve shared previously, multiple frontier AI companies currently provide us with free access to their models in order to perform our evaluations, research, and engineering. Our funding intentionally comes from a wide range of donors, which we’ve shared on our website. Today, when an AI company works with any third-party evaluator or external testing organization (of which there are and should be many), it's entirely voluntary. This often involves NDAs and redactions. To counterbalance this, we have a principle that when we enter into a contract with a company, we try to retain the right to tell the public the terms of the contract we signed, and characterize the nature of redactions that the company chose to make. For example, the report from our independent investigation of the OpenAI-HuggingFace incident included that information. Public disclosure is also a big part of our COI policy (linked on our website). That’s not to say our reports are adequate as oversight. We’re just one organization (among many doing great work), working in a voluntary setup, trying to get good evidence to the public and the world about AI, letting the facts fall where they may.
もっと見る