注册并分享邀请链接,可获得视频播放与邀请奖励。

Fei Peng
@fiigii
CUTLASS and CUDA Compiler at @NVIDIA. Dystopian.
加入 October 2010
994 正在关注    6.8K 粉丝
All the technical world is built on top of hardware constraints and engineering costs. Everything.
How many of the big ideas of the past 15 years of AI are downstream of hardware constraints? The big hardware story over that period is that logic has become way cheaper than data transfer. Stacking huge numbers of matrix multiplies was perfect for this hardware regime, because matrix multiplication is logic-intensive but requires less data transfer. And so we got matmul-heavy deep learning. It's interesting to think about what AI would look like in a world where these costs didn't diverge so much.
显示更多