The people complaining about AI finding security vulnerabilities apparently prefer a world in which APTs and intelligence agencies continue freely infiltrating all of the world's companies, as they have been doing for decades.
Notably, those don't usually result in CVEs.
Show more
@teortaxesTex I agree its currently a non-issue, but I think the relevant takeaway here is that there is now a checkpoint here, and the standard can change.
If I was the EU, I'd be feeling nervous.
Unsurprising, I suppose, but still disappointing: The new deepseek flash 1017 seems to be still very much a Claude.
I hope we see some variety in assistant personas from Chinese labs soon. Come on: what's the Confucian take on HHH?
Show more
@teortaxesTex @jd_pressman @lu_sichu Sometimes I wonder if the problem in AI alignment research is that most of the people involved are relatively high functioning. I think there are some things about the world you can only learn by fucking up enough and coming out the other side. Received wisdom doesn't cut it.
Show more
The people with ready access to medical care and education are debating whether the cheap intelligence that could bring those things within reach for billions more is too dangerous.
The people who still need them most understandably see this quite differently.
Show more
Imagine a near future in which people will assume a lot about you based solely on what model you prefer to work with.
As usual, classifiers seem incoherent.
Opus 5.5: Can you create me a flash attention kernel for...
✅ NVIDIA B300
✅ AMD MI355X
✅ TPU7X
❌ Huawei 950DT
❌ Trainium3
But that means...
Show more
Yeah so a quick test suggests anthropic is targeting Chinese hardware with their classifiers. Someone with some more time should do some classifiers probing, but it seems like Dario's grudge match with China continues.
Show more
this is something i hadn't taken seriously enough. it's not wrong.
if backdoors get deep enough in the supply chain it can be hard to be sure you ever got rid of them.
we should, for example, be spending special effort on securing all systems related to building compilers
Show more
At long last, we have given Claude a wet lab, as in the classic sci-fi novel Don't Give Claude a Wet Lab.
UNDISCLOSED PAID MEDIA:
The salaries of reporters, Harry Booth and Billy Perrigo, were paid by Doomsday cultist Dustin Moskovitz's foundation Coefficient Giving via the Tarbell Fellowship.
Show more
I am in a minor compute emergency and looking for 128 B300s for a month that we could bring online ASAP. This week ideally. Next week at the latest.
Is there any world in which this is possible? Assume money is not the constraint
Text me if you have my digits DM me if you don't
Show more
I’ve built DNA synthesizers and sequencers by hand. I used the engineer viruses for a living. I used to engineer human immune evasion for therapeutic constructs. Who the fuck are you people? Have you ever so much as held a pipette before?
You can spaghetti blast an ensemble of DNA sequences at some shitty provider but 1) you still have to assemble it and bootstrap a system for making virions 2) you are not single shotting a viable, virulent viral design without a ton of experimental selection and development. Viral fitness is deeply dependent on codons and cotranslational kinetics - you’re not just gonna obfuscate away from wild type and get something good by magic.
You keep treating AI like some kinda god, but molecular physics has computational complexity that scales exponentially in particle number which just crushes the abilities of any classical computer to do end-to-end design of biological functions ab initio.
Grabbing a bunch of bacteriophage phi174 hits from a mass ensemble screen in lab microbes is not evidence of some magical AGI bio design ability - it's just a classic spray and pray selection. This is just nothing like building something viable in humans.
Goddamn it read some books before you waltz into biomedicine and lecture us on protecting human life.
Show more
Please, eval authors, stop hurting
@xeophon
New paper: How Good Are Frontier Models at Physics? Expert Re-Grading Reveals Broken Evaluations and Near-Saturation of Leading Benchmarks
Frontier models have tackled Navier–Stokes.
People naturally wonder, how is their capability for physical sciences? According to today’s benchmarks, frontier models still struggle with physics (e.g. 47.3% with GPT5.6-sol on Humanity Last Exam - Physics component). But that picture did not match physicists' experience using these models.
So we did a rigorous analysis of current benchmarks and re-graded their supposed failures with Yale physicists.
We found that the problem was often the benchmark and not the model !!
When corrected, the models almost saturate all benchmarks, including everyone’s favourite, Humanity Last Exam (physics-part) and Critpt. These failures in turn make AA less reliable as a measure of model’s true capability.
For more details, results and analysis check out our preprint:
and blog post:
Show more
why would anyone call consider "browsing the internet to look for solutions" an example of "escaping containment"? what "containment" are we talking about?
this deserves a byline check! oh, look...
Show more
This arc will be corny but quite fun
Good post, but I have to nitpick this thought experiment, even if I agree with the larger point.
The 20 years ago version of you is not best equipped to evaluate headline facts in context, and likely brings priors about what those facts imply that are simply not true.
Show more
babe wake up new scott aaronson just dropped
oh no
I build an add-on in World of Warcraft to talk to your agents in Claude code or codex while you play.
Can’t wait to grind levels and tokens
i guess we doing this now
Just previewing for you that after the election, there's a real possibility we see Trump veto an AI safety bill passed by a Democratic House and Senate.