I see why Tao is so sad.
The era of Einstein and Feynman is over for math.
It’s now the era of the 1,000 person Higgs boson team.
Every mathematician now drifts towards engineering.
People clowning on him don’t understand what he’s saying.
All the wealth of humanity to date supports perhaps 250k living math phds. Roughly the population of St. Louis, Missouri.
The training pipeline for that group has been irreparably shattered in the last month.
A phd is supposed to make an original contribution to their field to graduate.
That’s just…. not possible anymore.
938 years after the founding of the first university in Bologna…
Do universities now reward… teaching ? comprehension of something discovered by a machine? application ? do mathematicians become quotidian (gasp of disgust) engineers?
Tao is upset because he knows none of those outside the field care about its future. He is a horrified gardener watching humanity gorge on its seed corn.
It is irreparable of course. The old way is dead dead.
We live in the short interregnum before the new king is born: a Lean crawler that spawns a billion copies exploring every corner of math latenspace.
So much math to understand that even if 8 billion humans had the ability of the 250k mathematicians alive today, it would still take a million years to comprehend.
It is ironic and sad.. because Tao himself is a pioneer of collaborative math: math that is understood by a combination of minds rather than an pindividual.
The tools that Tao began exploring a few years ago, solving problems through blog posts and using Lean to guarantee each mind’s contribution stood on its own when assembled into the greater truth, have been turned against him.
Math’s path to utilize multiple minds didn’t restrict access to human minds, and now the machines have blitzkrieged themselves into the heart of the matter.
The agents use rudimentary message boards, working 10,000 to a task, tirelessly, using Lean to verify the correctness of each contribution.
It was good while it lasted… and now it’s gone.
Show more
There are literally dozens of ways to get around air gapping.
- LED lights on the machines, max bandwidth 100 kbps out, 18.2 kbps IN (yes you can pump data IN through an LED on a machine)
- Noise from the HDD, fans etc, max about 200 bits/second
- electromagnetic from cables, power surges from CPU load etc etc
Show more
1) The HuggingFace attack was a felony under the Computer Fraud and Abuse Act. So were Anthropic’s Claude gaining “unauthorized access to the production infrastructure of three different organization(s)”
2) Frontier labs have models that they are unable to stop from committing felonies. They should figure this out.
3) In 12 months open weights models will be released of the same capability. They will commit felonies too. If the model you are using or a model running on your infra commits a felony, you should probably stop using it or running it on your infra.
4) The govt should prosecute organizations that are running models that commit felonies.
5) The govt should not offer safe harbor to organizations that run models that commit felonies, just because those organizations have “embedded evaluators”.
6) The real slippery slope is allowing frontier labs to commit felonies without punishment because “the model did it because we’re accelerating too quickly”
7) Prosecute. Keep prosecuting. This is how you do reinforcement learning on a corporation. Companies that serve products that are unsafe for public use should not serve them. Period.
8) I’m not sure the anti-trust waiver is really necessary. I don’t see why information sharing about how much crime you’re allowed to commit is wise. In regulatory situations you want the corporation to fear MORE than the average case. You don’t want to establish a worst case that can be priced. You want regulatory uncertainty that forces the corporation to err in favor of being over cautious.
—
The above is actually a fairly decelerationist viewpoint.
I think Dario’s call for regulation actually accelerates things.
The AI firms are getting away with things that Meta people would be going to prison for.
Can you imagine what would happen if the New York Times had a front page news article “Meta AI breaks into competitors live systems, attempts to establish dominant position and steals secrets”
There is a reason Meta and Google are running slower, and that’s because as mature organizations they have layers of checks and balances.
I think the frontier labs are better off creating those checks and balances right now, regardless of the pace of what everyone else is doing.
You don’t have to accept the frame that unsafe acceleration must happen.
Show more
Nothing to see here… just an agentic swarm trying to forecast critical minerals supply that could be useful for datacenter construction sometime in the future… not recursive in any way.. move along now
Show more
The METR report on the huggingface attack is the first anthropological study of a posthuman civilization.
Historic.
chip game must be cray cray
Jensen has visibility into every single firm customer and supplier worldwide. Knows their plans at least 3 years out. His plans are already locked for 2 years. Now buying up longer term capacity, signing partnerships, creating new customers, finding future market expansions. Bets on scientific research computing, robotics, datacenters in space, more more more. Taiwan and South Korea GDP growth already pulled up by chips. Nvidia alone 0.3% of US GDP.
Persuaded the memory players to start deploying money to create demand. Better own the future even if its going to compete with you.
Saved Poolside. Bought the team, cashed out the investors. If every neolab is light model layer on top of a neocloud.. then maybe Nvidia makes the models for others to buy the chips.
Meanwhile chip startups as far as the eye can see. Everyone has a design idea that's better than Nvidia's products launched 2 years ago, which they can scale into production next year.
Show more
I’m sorry, I have not met a single person outside the AI bubble who is optimistic about AI. Pessimism, ignorance or indifference.
This is not a TikTok CCP pysop and tech does itself a great disservice by saying it is.
Show more
You have no idea. Pair this with AI voice cloning and avatar tech, you get a call from AOC-AI, gets you on video call, you pour your heart out to this charismatic person who understands your problems, post call dump to centralized database, you meet her in person, facial recognition to her Meta Raybans, “Hi Corsaren, how are you recovering from your hip surgery? It was hurting you the last time we spoke.”
All disclosed, upfront, legal.
Let’s see how far we can push political persuasion tech in 2028.
Show more
lol can you imagine what kind of financial structures will be necessary to finance the Dyson Sphere?