Chipmakers work together more than people think.
In the history of compute, there's a repeated pattern.
As each workload matures, we divide it into stages.
Then we build specialized hardware for each stage.
In inference, it's called disaggregation.
There are 2 distinct stages:
Prefill - processing the prompt.
Decode - generating the answer.
The 2 stages need very different things.
Prefill is highly parallelizable.
Decode is strictly sequential.
Each stage is best served by a different machine.
Already, chipmakers are working together to use the best architecture for each stage.
At
@cerebras, we’re partnering with AWS and AMD to do exactly this.
Today, Tony Kim and I spoke about this and much more at the Future of The Data Center and Compute Summit 2026.
Thanks for having me, Tony.