Andrew Feldman
@andrewdfeldman
CEO and Founder @Cerebras (NASDAQ: CBRS) where we build the fastest AI infrastructure in the world.
Joined December 2015
217 Following 29.8K Followers
True
Moving bits to and from memory.
Because of parasitic capacitance+resistance of the wires.
The bigger the memory, the longer the wires.
The main trick is to organize the memory hierarchically: registers, small on-chip SRAM, caches of various types, and external RAM.
It's all because we have to use hardware multiplexing: reusing the same multiply-accumulate unit for multiple parts of the network.
Show more
