sharing a new long-form blog post: ai chip architectures
it covers the leading chip architectures (nvidia, amd, tpus, trainium, cerebras, groq) across architecture, scaling (scale-up and scale-out), and software stacks.
it helps build an intuition for the architectures and their trade-offs.
Show more
sharing a new long-form blog post: ai chip architectures
it covers the leading chip architectures (nvidia, amd, tpus, trainium, cerebras, groq) across architecture, scaling (scale-up and scale-out), and software stacks.
it helps build an intuition for the architectures and their trade-offs.
Show more
there’s so much more to do in ai & chip design. we’re still in the early days.
today’s improvements in intelligence/joule came with relatively weak co-design.
extreme co-design between model, harness, chip, and system will explode intelligence/joule. when the entire stack is treated as a single system to be optimized together.
this is just the beginning.
Show more
Intelligence/Joule will keep improving
Today, we're launching Standard Machines @stanmachines.
We build reinforcement-learning environments for chip design.
We want to push frontier model capabilities forward, and enable small teams to tape-out advanced chips in months.
Read more in our launch post,
Show more
Today, we're launching Standard Machines @stanmachines.
We build reinforcement-learning environments for chip design.
We want to push frontier model capabilities forward, and enable small teams to tape-out advanced chips in months.
Read more in our launch post,
Show more
BREAKING: Anthropic confirms it is building in-house custom chips which will be used to run Claude faster and more efficiently.
Details include:
1. The company is currently hiring engineers to design custom chips for its Claude
2. Anthropic says it will co-design its hardware and models to run "at the scale our customers need"
3. Anthropic will adopt a "multi-chip approach" in which hardware from AWS, Google, Nvidia, and AMD will remain essential
In-house AI chips are the next big trend.
Show more
future is bright
we have yet to live our best moments, or stand in all the places that will make us feel small in the best way possible way, or have conversations that will completely change us
The semiconductor market could double by 2030
More charts:
