Register and share your invite link to earn from video plays and referrals.

Steven Sinofsky
@stevesi
Subscribe • seed investing • writing • ॐ •🙏• I use '—' and no AI to write • tweets saved 90 days • 📷
5.5K Following    211.9K Followers
fascinating, he really is just quite dumb
0
192
5.3K
205
Forward to community
Sen. Bernie Moreno reveals his Senate office named its AI "Albert" and treats it like a staffer, even as the Senate still won't let offices integrate AI into their systems: "Oh, I use it a lot. So we actually named AI, we call him Albert. So Albert's a staffer in the office. He works long hours, doesn't require a lot of pay." "It's great for things that normally take somebody a period of time to vet, so we use it quite a bit. I personally would like to be using it a lot more." "Right now, the Senate prohibits us from integrating it into our systems. But I'm hoping to get that done next year." @berniemoreno
Show more
Fears the Internet could be ruined by autonomous exploit finding software is not new. In 1995 there was a huge debate about whether open source exploit finding software should be allowed.
Show more
Call yourself a factory only if you want to be judged like a factory.
By my definition, @OpenAI does not have a software factory. I referenced @GergelyOrosz article on OpenAI's development processes to examine what defines a "software factory" and what it says about the @OpenAI @AnthropicAI AI risk hype. Enjoy the read.
Show more
Every time someone says "training" replace that with engineering. And if the product needs more training or the training isn't working then you know what they mean is it needs more engineering.
Every time you brainstorm and come up with some CRAZY scenario you then decide how likely it is to happen, how bad the result could be, and then invest the right level in prevention and mitigation. You then verify those assumptions and work with testing. THIS IS THE ACTUAL DEFINITION OF ENGINEERING! "One professionally engaged in a branch of engineering that applies science and mathematics to develop practical solutions." The *practical* aspect with respect to bad outcomes is discovering faults, assigning risk, testing, and mitigating product changes. Right now the crazies are coming up with crazy stories and throwing their hands up as if nothing can possibly be done. RIDICULOUS.
Show more
OpenAI's Noam Brown says air-gapping the computers may not stop a misaligned AI, because two air-gapped machines can still talk by running a CPU hot and reading the temperature change "But I think the major takeaway from the incident is that people underestimated the AI. And we never want to be in a situation again where we underestimate the AI. It's a weird world, because AI progress is so fast that people are consistently underestimating the AI." "So to be in a situation where you don't underestimate it again, when it comes to safety and alignment, you have to have a very, very, very high bar." "You could even go as far as to say, "Well, we should air gap the computers." And I'm not convinced that that would be sufficient." "There are studies, and this is mostly academic, where you can have two computers next to each other that are air-gapped and they're still able to communicate with each other because they have temperature sensors." "One of them is able to run their CPU really hot, and then the other one can actually detect the temperature change, and then that actually gives them a mechanism to communicate." _________ Link and more key quotes from OpenAI's safety related conversations:
Show more
Yes a million times.
Jensen Huang says the rule for shipping AI is the same rule as shipping an omelet "And in doing so, if it's not ready, just hold it back. You should go as fast as you can, but no faster than that." "At the moment, the incidents are related to products not ready to be released. This is no different than, you know, an omelet's not ready to be released, or a car's not ready to be released, an airplane engine not ready to be released. You should properly test it, you have rigorous testing systems." "The testing lab should be contained and products should not be released to the public until it's ready to be used by the public." "And that's engineering, good old-fashioned engineering. It's not more than that, it's not less than that. And so we have to just go back to core engineering, make sure that we have the rigor of testing these products properly before we release it to the public." _______ Link and more from AI-safety related conversations:
Show more
Over 2 years ago @sayashk and I wrote a detailed deconstruction of p(doom) and argued that its primary function is to launder vague, evidence-free intuitions and fears through a facade of quantification. It remains 100% relevant today.
Show more
I’ve given Claude Opus various published papers (and my own unpublished ones) and asked it to review them. (Don’t panic—I’m not uploading confidential manuscripts.) The reviews it produces are excellent. It finds statistical errors, internal contradictions, and conceptual confusions that human reviewers miss; it provides useful suggestions; it has a good sense of what counts as significant and novel and what doesn’t; and it’s generous in its appreciation for what the authors get right. And it doesn’t suffer from the strong “myside bias” humans have; it doesn’t recommend rejection because the author didn’t cite it enough; it doesn’t insult the authors; and it doesn’t agree to write a review and then never send anything in. As a journal editor, I’m not sure what to do with this. If I gave up on human reviewers and used GPT-5.6 Sol and Claude Opus instead, my bosses would fire me, probably rightfully so. The only constructive thing I can recommend is that, before submitting something to a journal, researchers and scholars use this tremendously valuable resource. (Just don’t tell the models that it’s your paper, because they do suffer from sycophancy.)
Show more
Incredible.
BREAKING: The Washington State Supreme Court has just overturned another law passed by voters, ruling that the initiative protecting your right to use natural gas in your home and business is UNCONSTITUTIONAL. Unreal.
Show more
There needs to be a Betteridge's-like law for headlines "A Majority of Americans Believe..."
This is wild. (I would have said "very small risk.")
"This recent fear about AI leading the human extinction and so on is much more science fiction than science. It's very damaging." Prof Andrew Andrew Ng on Bloomberg with @EdLudlow ---- From "Bloomberg Tech" YouTube channel, (full video link in comment)
Show more
One of Michael Moritz's best stories on obsession is about the ride he got from Bill Gates when Microsoft was still private. "Bill Gates gave me a ride to the airport in his car. The radio was missing in the car, a big, gaping hole in the dashboard. I said, Bill, what happened to you, did you get ripped off? And he said no, I had it taken out. Why'd you have it taken out? Well, I drive from my home to the office, which is 7 minutes and 32 seconds, and then I'll drive from the office to the airport, which is however long. And he said if I've got the radio, I'm afraid that I'll switch it on and I won't be thinking about Microsoft. That's obsession."
Show more
My conversation with Michael Moritz, one of the great venture investors of the last 40 years. Michael joined Sequoia in 1986 and co-led the firm with Doug Leone (@dougleone) from 1995 to 2012. His investments include Google, Yahoo, PayPal, and Stripe. His new book, Ausländer, traces his parents' escape from Nazi Germany and helps explain his lifelong interest in what shapes exceptional people. We discuss: - The infamous Steve Jobs profile - Why Don Valentine hired him - The question he finds most revealing when interviewing people - Monomania and the cost of greatness - Why he has never felt good at anything - Writing, journalism and AI - What he learned about himself writing Ausländer I'd recommend watching this one if you can. Michael was incredibly thoughtful and reflective throughout, particularly when talking about his parents, childhood, and the more difficult parts of his personal story. Enjoy! TIMESTAMPS 0:00 Intro 0:53 Family History & Identity 7:03 Survival & Outsider Instinct 18:53 Studying Exceptional People 33:50 Self-Doubt & Success 41:17 Steve Jobs & Obsession 52:50 Joining Sequoia 1:03:22 Leadership & Alex Ferguson 1:08:25 Elon Musk & AI 1:17:12 Becoming Who You Are
Show more
The law is super clear and fits precisely with what happened. It came about after a breach quite similar to the unauthorized use at HF.
Hugging Face got hit by an AI-led cyberattack. Their CEO's response? Existing cyber laws are probably enough to govern advanced AI. "I'm not even sure that we need to reinvent the wheel." That's a remarkable position to hold after your own company becomes a case study for why the current framework might be failing. The attack wasn't a phishing scam or a script kiddie — it was AI-driven. That's a qualitatively different threat model than what most cyber law was written to handle. The argument for regulatory restraint usually comes from people who haven't had skin in the game. Here, the CEO has skin in the game and still lands there. That's either principled consistency or a dangerous blind spot dressed as pragmatism. The market is going to find out which one pretty fast.
Show more
"We're all going to be ok" We need more Sriram voice and more precision and reality.
Former Senior White House Policy Advisor @sriramk discusses AI risk & why he says "we are not going to die."
When someone says "alignment" replace it with product specification and documentation and ask to see it. We don't expect APIs or Apps to just do stuff without knowing what they should do, side effects, error states, cost, etc. We expect documentation and accountability.
Show more
I said a whole lot on this one. Kind of a rant about alignment, bugs, anthropomorphism, and accountability. tl;dr it is software product development. Start acting like engineers.
"Why only pace, why not pause? This stuff sounds really dangerous"
“I would have written a shorter letter, but I did not have the time” — your AI slop cannon
Lazy work used to mean too little output. Now, with AI, it often means too much and more work for everyone else. @tobi call it "slop grenades." A "Slop Grenade" is when you let AI produce the work and pass it on without adding any value (including checking it). Someone else has to wade through it, catch the mistakes, and clean up the mess. You save time and look productive but someone else pays for it.
Show more