註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

Andrew Feldman
@andrewdfeldman
CEO and Founder @Cerebras (NASDAQ: CBRS) where we build the fastest AI infrastructure in the world.
加入 December 2015
229 正在關注    33.6K 粉絲
Chipmakers work together more than people think. In the history of compute, there's a repeated pattern. As each workload matures, we divide it into stages. Then we build specialized hardware for each stage. In inference, it's called disaggregation. There are 2 distinct stages: Prefill - processing the prompt. Decode - generating the answer. The 2 stages need very different things. Prefill is highly parallelizable. Decode is strictly sequential. Each stage is best served by a different machine. Already, chipmakers are working together to use the best architecture for each stage. At @cerebras, we’re partnering with AWS and AMD to do exactly this. Today, Tony Kim and I spoke about this and much more at the Future of The Data Center and Compute Summit 2026. Thanks for having me, Tony.
顯示更多
0
13
110
7
轉發到社區