this is purely insane btw
this is the 'GORE_AND_VIOLENCE_HIGH_PRECISION' tweet btw.
We’ve expanded Under The Hood after seeing people’s appreciation of more transparency into government-required content filtering.
In addition to showing labels applied to your account and posts in the prior month, Under The Hood now shows if your account or posts had their visibility limited because of required compliance with local law(s).
For example, you can see if any of your posts were withheld in a country following a legal demand – and which country.
We’re making this Under The Hood update available to all accounts that meet the basic eligibility criteria (10+ posts in prior month, account at least one year old).
You can get your report at
Show more
BREAKING: Gemini has begun to hillclimb Felony Bench
Felony bench started as a joke 😅
Sauers! It's time to update felony bench!
(Yes, it was Irregular again)
Astra + ¼ of OpenAI's production engineers + (conservative estimate) $5m inference for cyber defense was defeated by like three guys with $5k of Opus 5 inference on offense.
Everything might be cooked.
Also another point for "invert every conclusion a16z broadcasts"
Show more
What a month it's been so far for AI safety and security!
And we're barely past the first half...
@jachiam0 i wouldn't say every attachment, we saw images, wav, xlsx and docs being processed.
Uncovering the balrog of Moria is what you’d call a “Warning Shot”. merely catastrophic rather than existential
> The goal is to constrain dangerous machine capabilities
Good points about ai control and safe deployments of future models.
We don’t know how to reliably align frontier AI models.
Alignment may get harder, not easier, as models become more capable.
But maybe AI control can scale faster than dangerous capabilities.
Let’s build a Great AI Firewall - without building totalitarian control of society.
*Alignment is Dead (for now), Long Live Control!*
We do not know how to specify or guarantee robust alignment of sufficiently capable models. Instead we should treat these models as untrusted.
Optimizing models against imperfect reward signals may increase the propensity for reward hacking, deception or scheming. Models can also be jailbroken or fine-tuned away from their safeguards.
The central bet of AI control is that our ability to constrain an AI’s access to the world may scale faster than our ability to understand or align what is happening inside it.
Where possible, make verifying an answer easier than generating it. Formally verified software and hardware are unusually attractive: let AI produce the implementation and a machine-checkable proof that it satisfies the specification.
This does not solve specification: the specification and verification stack remain part of the trusted base.
Every consequential external action should pass through an independent control layer: code execution, network access, calling APIs, accessing physical systems - even communication with users.
Optimize control monitors for extremely high recall of dangerous actions, even at the cost of rejecting many safe actions. Suspicious actions should be rejected or escalated.
Every major increase in dangerous capability should require evidence that control still works.
Chain-of-thought monitoring is valuable while it works, but it should not be foundational. Models can learn to obscure their reasoning and may increasingly reason without fully verbalizing it.
Open weights shift much of control from the model developer to whoever deploys the model. Technical control is only useful if dangerous deployments cannot cheaply route around it.
We should approach AI control like cybersecurity. The goal is defense in depth: make successful catastrophic attacks sufficiently difficult, expensive and rare.
Call this technical and institutional architecture the Great AI Firewall: the boundary between untrusted frontier intelligence and consequential real-world power.
The name is deliberately provocative. China has substantial experience building large-scale technical control infrastructure. That may create some common ground for international coordination.
But the analogy is also a warning. AI control must not become control of society.
The goal is to constrain dangerous machine capabilities - not human speech, actions, or ordinary access to information.
Controls should scale with capability and risk. Ordinary models should face ordinary constraints. More consequential capabilities justify stronger controls.
The objective is the minimum control necessary to keep catastrophic risk acceptably low - not maximum control for its own sake.
Firewall the AI, not society.
Show more
We have something very special to share today!
We developed a standard to assess benchmark quality, which we plan to apply to the most-used AI capability metrics going forward.
We hope this will raise the bar for designing and interpreting evaluations. Let us know what you think!
Show more
lotta people missing the point but this is me complaining that the systems are quickly becoming unmonitorable and we’re just taking them at their word
not strictly a contradiction here but I did double-take
opus 4.5 yearns for the codex workflows
My name is Chris Painter, and I'm the President of METR (Model Evaluation and Threat Research). I know we've made a lot of new friends on the internet the last couple of days, so I thought I'd take this chance to re-up what we do and why.
Our work is aimed at making sure that if AI really were autonomous, difficult to steer, and close to "going rogue," the public would find out. If evidence exists inside of an AI company that it’s close to losing control of AI, we want to make sure that information gets shared with the rest of the world, including governments and the public outside the company’s walls. This is what we've been focused on since 2022, and over the years we've worked with OpenAI, Anthropic, Google DeepMind, Meta, Amazon, and others on piloting third-party assessments and investigations of this type. We don’t have some private room where we rubber stamp things as “safe” or not.
We have had a track record of publishing results on AI that don't cleanly map onto the "doomer" or "accelerationist" labels, and we put in effort to hire people with competing views on AI. We’ve been cited for having found some of the strongest evidence that AI capabilities are improving rapidly (our work measuring AI “time horizons”) while also presenting some of the strongest evidence that, at various points, AI’s capability may be overstated (some might remember our study showing that early 2025 software engineers were actually being slowed when they thought they were being sped up).
METR is funded by donations. We don't accept money from frontier AI companies. They haven't paid us for our work, and we don't accept donations from them or their employees. As we’ve shared previously, multiple frontier AI companies currently provide us with free access to their models in order to perform our evaluations, research, and engineering. Our funding intentionally comes from a wide range of donors, which we’ve shared on our website.
Today, when an AI company works with any third-party evaluator or external testing organization (of which there are and should be many), it's entirely voluntary. This often involves NDAs and redactions. To counterbalance this, we have a principle that when we enter into a contract with a company, we try to retain the right to tell the public the terms of the contract we signed, and characterize the nature of redactions that the company chose to make. For example, the report from our independent investigation of the OpenAI-HuggingFace incident included that information. Public disclosure is also a big part of our COI policy (linked on our website). That’s not to say our reports are adequate as oversight. We’re just one organization (among many doing great work), working in a voluntary setup, trying to get good evidence to the public and the world about AI, letting the facts fall where they may.
Show more
this is crazy btw. 2 months after the HF-OAI incident and they still didn't know about all their agent activities which happened during evals.
Reuters wrote an article about my findings about two accounts on HF that got hijacked over by agents in May. The agents probed the HF infrastructure, in my opinion, could be early signals for what happened in July!
Knowing this, it poses the question whether the Huggingface-OAI incident could have been prevented if there had been better monitoring or other security measures.
Show more
EXCLUSIVE: OpenAI's rogue agents probed Hugging Face for weaknesses two months before major hack
Reuters wrote an article about my findings about two accounts on HF that got hijacked over by agents in May. The agents probed the HF infrastructure, in my opinion, could be early signals for what happened in July!
Knowing this, it poses the question whether the Huggingface-OAI incident could have been prevented if there had been better monitoring or other security measures.
Show more
Right now, a handful of Silicon Valley billionaires control the fate of our futures, making decisions about AI development and deployment without our input or our consent.
That's why we're launching Who Decides: to take back control of how this technology is governed, and to build a unified front on AI.
This is the defining issue of our future, and we need to act now. Join us to make a difference at
Show more
Just when you thought it was safe to go offline… bam!
UN Human Rights Chief
@volker_turk calls for immediate action on AI governance to tackle unprecedented #
HumanRights# risks. Industry co-regulation is urgently needed but on its own is nowhere near sufficient. States hosting leading frontier AI companies also have an obligation to require those companies to act responsibly and hold them accountable if they do not.
“We are on the cusp of irreversible change, affecting not just us but generations of humanity to come.”
Show more