btw anthropic's internal document on this literally said "we don't want it to be known that we are working on this.” it was called project panama. here's exactly what happened: 1: anthropic concluded that books were the cheapest way to build a world-class model because they gave claude curated facts, structured arguments, compelling stories, and writing “an editor would approve of.” 2: once anthropic decided it needed books at enormous scale, its first solution was piracy. it downloaded 7m+ books from online libraries including libgen. the judge later wrote that although anthropic had legal ways to buy them, it chose piracy to avoid what dario amodei called the “legal/practice/business slog.” 3: that piracy created a massive legal risk. so in february 2024, anthropic hired tom turvey, the former head of partnerships for google books, to find a legally safer way of obtaining “all the books in the world.” 4: turvey first contacted major publishers about licensing their catalogs. those attempts didn’t produce agreements, so anthropic chose a route that required no publisher permission: buying millions of physical books through distributors and used-book retailers. 5: within about a year, anthropic spent tens of millions acquiring and scanning millions of books, including many rare and 1/1 titles. one vendor proposal targeted 500,000 to 2 million books in six months. 6: to scan that many books within months, the vendors physically dismantled them. a hydraulic cutter removed each spine. the pages were trimmed to size, fed as loose sheets through high-speed industrial scanners, and converted into searchable PDFs. the paper remains were then sent for recycling. 7: these PDFs were fed into claude as training data. the complete collection became a private, searchable anthropic library that the company planned to “store forever.” the scans aren’t available to the public and were never open-sourced.

Releasing the model weights and technical report of Kimi K3. Kimi K3 is our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture: 2.5x the intelligence per unit of compute, not just more params. Alongside Kimi K3, we're opening up more of the stack behind it — high-performance attention kernels, MoE communication library, and infrastructure for running agent environments at scale. Model weights: Tech report: Tech blog:

Warning my friends: for the sake of saying that distillation is a good thing, and not a bad one, you are falling in the trap of admitting that frontier Chinese models are *mainly* the result of distillation (which is not just not true, but also not possible).

I'm a big fan of Uncle Bob and his books. But we also have to take into consideration that he is speaking from the perspective of a person who has been coding for longer than most of us have been alive. This means he has the experience, intuition, and taste to build the right constraints and guardrails around AI agents to make sure the code they generate is reliable. For people who are new to the game, learning to read and write code should be a prerequisite to using AI coding tools for anything that is beyond a prototype or a hobby project.

For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models.

Rails was born in Dec 2003, but took its first steps in the world with the launch of the first release: v0.5.0 on July 24, 2004. Thank you to the 7000+ programmers who have contributed to Rails since then and made the framework what it is today.

JUST IN: Chinese mathematicians, Wang Hong & Deng Yu, WIN the Fields Medal for the FIRST time in history!🏅🇨🇳 Known as the "Nobel Prize of mathematics", the Fields Medal is awarded only once every 4 years to mathematicians under 40. This is even harder than the Nobel Prize!

One rocket, nine satellites! Chinese Gravity-1 rocket launches new satellites from sea China on Wednesday sent a Gravity-1 carrier rocket into space from waters off the coast of Shanghai in east China, marking a complete success for this flight test mission. The Taiyuan Satellite Launch Center launched the commercial rocket at 10:54 a.m. (Beijing Time), placing nine satellites into their designated orbits. This flight marks Gravity-1's first open-sea launch and China's first commercial sea-based launch in the East China Sea off the Yangtze River Delta. Unrestricted by fixed maritime zones, the mobile launch platform allows for flexible site selection, enhancing launch efficiency and promoting a diversified layout for China's space launch capabilities. Project officials noted that the mission further verified the adaptability of the rocket model's solid-strap-on configuration to complex sea conditions and its extended standby capability. Developed by the Chinese commercial aerospace company, OrienSpace, the medium-lift Gravity-1 has a low-Earth-orbit payload capacity of 6.5 tonnes and is capable of delivering a 4.2-tonne payload to a 500-km sun-synchronous orbit, catering to various multi-satellite deployment missions. The deployed satellites will serve diverse purposes, ranging from all-weather Earth observation and commercial industry services to technical test. #Gravity1# #ChinaSpace# #SatelliteLaunch# #TaiyuanSatelliteLaunchCenter# #SpaceNews# #RocketLaunch# #YangtzeRiverDelta#

I see very worrying US companies executives declarations depicting open weight models as a risk. How much sold to the most furious capitalistic vision you need to be, to really believe it is better that a few companies control AI for all the world? They said the same for OSS.

Big news: Kimi-K3 by @Kimi_Moonshot is now #1# in the Frontend Code Arena with 1679 pts, surpassing Claude Fable 5. This is a 17-place jump from Kimi-k2.6 (#18# -> #1#). In Frontend, Kimi-K3 ranked #1# in 6 of 7 domains: Brand & Marketing, Reference-Based Design, Data & Analytics, Consumer Product, Simulations, and Content Creation Tools, landing #2# only in Gaming behind Fable 5. The full model weights will be released by July 27. Congrats to the @Kimi_Moonshot team on this major milestone!

29 countries, including China, Kazakhstan, Laos, Pakistan, Russia and Indonesia, signed the Agreement on the Establishment of the World Artificial Intelligence Cooperation Organization (WAICO) in Shanghai. 🔗

20 years ago: "I have a deep sense of responsibility for the productivity of the world. There’s so much to do that I’ll be damned if we’re not doing it the best way possible. And now I found a way. Or at least part of one. I’d be ashamed of myself if I weren’t trying to share."

Socially smart people often won’t tell you to your face when they disagree with you because they can sense intuitively that you are too attached to the outcome of the interaction and that you couldn’t handle disagreement. So they will just agree with you… but then you might not hear from them again. It’s easy to assume this is “fake” when really it’s just what intelligent people do to protect their energy. If you went around saying what you really thought all of the time you’d make way too many enemies, and get in way too many unproductive arguments (cortisol spikes = aging) Of course the only way to make genuine connections is to say what you really think… but especially if you intend to be deeply involved in society, you must train your intuition to know who can take it.

I’m convinced that a large % of programmers don’t actually like computers. As a side effect, are also perfectly happy to throw away their reasoning to a model as soon as they can. I don’t get it, at ALL. Don’t you *LIKE* understanding the magic of the machine? You do realize hand-programming (I hate that I even have to specify hand now) is fun…right?

The rise and fall of wokeness: DEI commitments in corporate securities disclosures filed with the SEC. To me this seems a trailing indicator; most other measures of wokeness take off well before 2019 and peak in 2020 or 2021. But the shape! That's what a moral fashion looks like.