Register and share your invite link to earn from video plays and referrals.

Search results for 8149
8149 community
One keyword maps to one global community path.
Create community
People
Not Found
Tweets including 8149
Something worth more discussion for anyone who compares AI chips on FLOP/s. Epoch's new Inference Performance Index puts a GB300 at about 25x an H100's inference capacity per chip on agentic workloads. On 8-bit FLOP/s the gap is only 2.5x, so the spec sheet understates it by about 10x. The difference is memory bandwidth and chip-to-chip communication. When an agent is holding a long context and streaming tokens, those can matter more than raw arithmetic. Google's new TPU 8i Max is built around the same point. It doubles the HBM bandwidth of TPU 8i, because once dozens of agents work across a codebase at once, memory bandwidth becomes the bottleneck. The newest racks add far more agent capacity than their FLOP/s headline suggests. If you're sizing the buildout for agents, count how many requests each rack can serve at once, and the case for the newest systems gets a lot stronger
Show more
Things we got before GTA 6 • ChatGPT and Claude • AI won gold at the International Math Olympiad • Erdős problems open since 1970, solved by AI • Fermat's Last Theorem formalised in 30 hours • AI solved protein folding • RSI • Consumer AI agents • Nvidia at $5T • H100s, then B200s, then GB300s • Starlink • Rockets that land themselves • Flying cars you can preorder Rockstar shipped one game while the rest of us rebuilt the entire compute stack
Show more
A few things from the Claude Fable 5.2 launch that tell you where compute demand is heading. 1/ One Anthropic engineer gave it an empty folder and asked for an operating system. It coordinated over 1,000 subagents working around the clock for eight days, and the OS boots on a laptop. 2/ A team of 1,000 Fable agents formalised Fermat's Last Theorem in 30 hours. Anthropic's first attempt took 11 days. 3/ Over 90% of the changes merged into Anthropic's core codebase are now written by Claude. 4/ Fast mode runs up to 2.5x faster at double the token price. Speed is now something teams pay extra for. The unit of work is turning into a thousand agents running for days, and every one of them is burning inference the whole time. Doesn't look like demand for compute is slowing down anytime soon. I think most people still underestimate how much inference this kind of work is going to need
Show more
A lot of AI hardware stocks got sold yesterday on worries about a data centre slowdown. Korea's export numbers tell a very different story. Korea shipped $56.4B of semiconductors in October, up 259% on a year ago. That's nearly half of everything the country exported last month. Most of it is memory, at about $50B. Computer exports, driven by AI servers and server SSDs, were up 497% to $5.85B. Prices and volumes both stayed high as big tech keeps spending to stay ahead in AI. Total exports hit $115.3B, and Korea now expects to pass $1 trillion for the year sometime this month. This is the closest thing we have to a live read on AI hardware demand. It lands on the 1st of every month, weeks before anyone's earnings call. Stocks can have a rough day for all sorts of reasons. The chips are still shipping at record pace, and I don't see a slowdown anywhere in these numbers
Show more
Coding agents broke OpenAI's Git. Codex sped up their engineers so much that by the end of last year the monorepo couldn't keep up. Slow pushes, failed merges, and reliability at times below 90%. The work multiplies. One engineer now has several changes heading to CI at once, and every push sets off more jobs fetching the same code. So they built a new Git backend called Pando. It went from kick-off to production in 10 weeks, designed by one engineer and written by teams of agents. Median push latency is down nearly 80%, and it now serves close to a petabyte of Git data a day. This is what agents do to infrastructure. Every agent is another worker pushing code, running tests and pulling data, and all of that lands on storage, networks and CPUs as well as GPUs. OpenAI hit the wall first because they use agents more than almost anyone, so at least the rest of us know what's coming. Every company that rolls out agents at scale is going to need a lot more infrastructure under them than it planned for
Show more
Anthropic spent $5.0B on short-term compute in Q3 alone. That's the line in the new S-1 I keep coming back to. Anthropic books most of its compute on multi-year deals, 12 to 18 months before it's available. When demand runs past that plan, it buys short-term capacity, and that capacity costs significantly more. So in the quarter revenue hit $17.0B, demand ran far enough past what they'd booked that they paid up for $5.0B of extra compute. Along with a $2.0B non-cash charge, that's what swung them to a $567M operating loss after a $974M operating profit in Q2. And it's going to keep happening. They expect to use more short-term compute in the near term. The bears will call this a margin problem. To me it's the clearest demand signal in the whole filing. It also tells you where the next dollar goes. The biggest buyers of compute are already running past their long-term plans, and every provider with GPUs live today is part of the answer
Show more
Marvell is buying Lumentum, the laser company, in an all-stock deal that values it at about $115B. In my opinion this is the clearest sign yet that the next bottleneck in AI clusters is connectivity. Lumentum makes the lasers and optical parts that move data between GPUs. Marvell makes the chips on the electrical side. Put them in one company and you can design the whole path a signal takes, from inside the chip package out to the next data centre. Marvell's own deck shows why. Data moving between data centres is the 1x baseline. Inside a rack it's 100x. Inside the package it's 1000x. Every step closer to the GPU needs far more bandwidth, and that's where optics are heading next. They put the combined market at $550B by 2030. Nobody pays $115B for lasers unless they expect clusters to keep getting bigger for years. I think the links between GPUs are about to matter as much as the GPUs themselves
Show more
Who Checks the GPUs Behind the Loan? Private credit has lent a lot against GPUs. Those loans are getting securitized now, and whoever buys the bonds will want proof the chips exist and actually perform. It's already happening. Stonebriar priced an $869M equipment ABS in October with GPU loans making up about 15% of the pool. Wingspire's $407M deal, roughly a fifth GPU loans, was 5x oversubscribed. Lambda's $926M term loan, secured by the GPU servers it funds and an NVIDIA take or pay contract, got a Baa2 from Moody's. What lenders are really underwriting is the contract and the operator. Serial numbers, live telemetry and a creditworthy customer paying every month are how you prove a GPU exists and works. Securitization is what happens when an asset class becomes normal. The operators with clean data and real customers will end up with the cheapest money in this market
Show more
The neocloud boom is the most exciting thing happening in AI infrastructure right now, and it's also where the gap between talking and building is widest Every week I see another team announce they're "becoming a cloud". Some raised for a different idea and found that GPU capacity is the thing customers are actually paying for. Rental rates keep moving up, demand keeps outrunning supply and the capital is there, so it makes sense that people are jumping in What a lot of new entrants learn the hard way is that the business barely lives in the GPUs. You can wire money for hardware in an afternoon. Then you need power that's actually contracted, a site with the right cooling, networking that holds up under real training loads, and a crew that can get all of it live on the exact date you promised your customer That ready for service date is everything. A customer who signed for capacity in March has a model to train, a product to ship and their own investors to answer to. If you slip by two months, you've pushed their whole roadmap back So the providers who win this cycle look a bit boring from the outside. They've brought clusters online before. They know the local electrician by name. They plan for the transformer arriving late and the permit taking longer than it should. They treat a delivery date like a promise to someone else's business That's also what lenders and customers will pay up for. Plenty of buyers want to work with smaller and more flexible providers because the big clouds can't always give them the capacity, the timing or the price they need. That demand is real and it keeps growing. What they need is confidence that the capacity will actually show up The long tail of compute providers is here to stay and it's healthy for the whole market. Over the next couple of years the ones who execute will pull way ahead, and the teams who can bring a cluster online on time, every time, are going to be worth their weight in gold At Aethir we spend a lot of time on exactly this, because getting the compute to show up is the whole job If you're building in this space, go hire the people who've done it before. They're the scarcest resource in AI right now
Show more
The two most important words in all of learning science: Retrieval Practice.