Register and share your invite link to earn from video plays and referrals.

Freda Duan
@FredaDuan
No investment advice.
Joined January 2021
371 Following    41.2K Followers
I got a lot of thoughtful feedback after publishing the original post - thank you to everyone who took the time to read it, challenge the assumptions, and share data points. A few of the pushbacks changed how I think about the framework, so I wanted to write a short follow-up and lay out the main areas of disagreement. Where the feedback roughly landed Most clustered around ~0.2–0.3GW for standalone/agent CPU at 100M DAU, versus ~0.1GW in my original estimate. Inference demand is all over the place. --- 1/ My CPU scope was too narrow. My original CPU estimate focused mainly on the agent sandbox/VM. Separately, my inference estimate modeled GPUs, but did not include the head-node CPUs that support the GPU fleet. One clarification: tool execution is not necessarily a separate CPU bucket. Browsers, code, and tools often run inside the sandbox itself; orchestration may run in a separate backend or share other CPU infrastructure. So I now think about CPU demand as two main pieces: Standalone / agent-execution CPU Sandbox + the actual work happening inside it + some orchestration Head-node CPU CPU required alongside the GPU/XPU fleet ≈ GPU/XPU fleet × CPU attach rate 2/ The sandbox itself may need more CPU than I assumed. The original estimate used the 2 vCPU environment exposed by Muse as a starting point. But provisioning a lightweight VM is different from the physical CPU consumed once agents are actively running browsers, code, tools, and multiple tasks. The bigger long-term question is also whether one human request continues to map to one agent. A request could increasingly spawn 4–8 sub-agents, or eventually become agent → agent → agent. Usage will likely be highly skewed toward power users, and infrastructure also needs to be provisioned for peaks rather than averages. A more complete framework is: Standalone CPU demand users × tasks/user/day × agents/task × active time/agent × physical CPU per active agent × peak factor There are a lot of moving pieces here, but I suspect agents per task is one of the biggest long-term swing factors. 3/ Inference may also be understated, but for a different reason. The relevant unit probably isn’t simply “human messages per day.” A consumer might only initiate 5–10 meaningful tasks per day, but one agent task could require dozens of model calls as the agent reasons, uses a tool, observes the result, reasons again, etc. So a better framework is: GPU inference demand users × tasks/user/day × agents/task × model steps/agent × tokens/step This is also where the feedback was most dispersed. Some people think 50+ model steps for a meaningful agent task is completely reasonable; others think an assumption of 50 consumer-initiated events per day is far too high. Those aren’t necessarily contradictory - tasks/day and model steps/task are different assumptions. --- How this compares with sell-side CPU math The sell-side approach is generally much more top-down. Using BofA as one example - they estimate total data-center systems TAM growing from roughly $506B in 2025 to $2.56T in 2030, while assuming CPUs remain around 7–8% of total system value. That gets them to roughly $211B of server CPU TAM in 2030. Their CPU bull case is essentially: AI infrastructure spending gets much larger × AI becomes more CPU-intensive relative to GPUs × agents create a new standalone CPU compute layer × AI CPUs get more expensive / higher-spec BofA splits the 2030 number into roughly $90B of GPU-attached/head-node CPUs, $90B of standalone agentic CPUs, and ~$30B of traditional server CPUs. ++ Better formatted version: ++ Thank you again to everyone who challenged the assumptions and shared thoughtful feedback - I learned a lot from it!
Show more