Many people think that LLMs are limited by human training data, but pretraining is just establishing a common sense baseline. Most compute goes into reinforcement learning now, allowing models to move beyond the human level by exploring themselves, just as they did with Go.
Show more
We have to defeat doomerism. Rage, rage against the dying of the light. I stand on the side of a humanity armed with strong AI.
I disagree with the doomer position: I believe that we need to build powerful AI to solve the problems our civilization is facing, and that we will be able to control it. Also, most of the doomers are sincere, intelligent and have the best intentions, I regard many as friends.
Show more
The reason why academics, individuals and small startups can play with AI are open weights models. The future looks pretty dire for decentralized open source AI, because there is a large and well funded lobby against them, and very little organization to lobby for them.
Show more
Nobody is planning to stop or pause AI. Big tech companies and governments will be improving and using frontier AI as a matter of course. But a lot of people are aiming to keep capable AI models out of the hands of the general public.
Show more
I wish people would notice that the safety scare is not driven by people outside of the big labs, but directly from their leadership. The "whistleblowers" are plants that are amplified from within the labs, and supported by the CEOs. The goal is to capture the regulators, which will not shut down the big labs, but turn them into an oligopoly and outlaw decentralized AI.
Show more
Anthropic and OpenAI cannot become profitable unless they can reduce the ratio of training cost to inference profits. In the long run, their survival may depend on outlawing competitive open source models. This can only be done under the guise of safety regulation.
Show more
Minds are not physical and cannot exist in the physical universe, for the same reason that Minecraft is not physical and cannot exist in the physical universe. Physics has nothing meaningful to say about consciousness. Minds require universes with different laws than physics.
Show more
Using LLMs to participate in an intellectual conversation is like sending an AI sexbot to your dates
A robust right to compute, to think about whatever you want with whatever tool at your disposal, is not just a consequence of the First Amendment, but also a demand of the second. A free citizen must also have the right to own the tools to entertain thoughts that are not harmless
Show more
@peterrhague I am pretty sure that he received hundreds or thousands of messages by people who wanted it to end this way, or worse. Yes, no reasonable, high integrity person wanted it to end this way, but you may have no idea what a cancellation unleashes (don't ask me how I know)
Show more
