Zhifei Li
@andylizf
参加 July 2022
116 フォロー中 238 ファン
one of the most annoying things in MLSys: tiny ops keep forcing data to move around
CODA: do them before the tile leaves the chip
LLM training is built on fast MatMuls. But many surrounding ops still run as memory-bound kernels.
CODA reparameterizes them to hide in the matmul’s shadow, fused into its epilogue before results leave the chip.
Bonus: LLMs can write fast CODA kernels too (approaching SoLs).
もっと見る
