Sander Dieleman(@sedielem):New blog post about diffusion language models: https://t.co/uMF2BZNCqZ Diffusion models have completely taken over generative modelling of perceptual signals -- why is autoregression still the name of the game for language modelling? And can we do anything about that?

Sander Dieleman

@sedielem

Research Scientist at Google DeepMind (WaveNet, Imagen, Veo). I tweet about deep learning (research + software), music, generative models (personal account).

加入 December 2014

2K 正在關注 67.9K 粉絲

Sander Dieleman@sedielem

2023.01.09 14:40

New blog post about diffusion language models: Diffusion models have completely taken over generative modelling of perceptual signals -- why is autoregression still the name of the game for language modelling? And can we do anything about that?