Sander Dieleman(@sedielem):New blog post about diffusion language models: https://t.co/uMF2BZNCqZ Diffusion models have completely taken over generative modelling of perceptual signals -- why is autoregression still the name of the game for language modelling? And can we do anything about that?

Sander Dieleman

@sedielem

Research Scientist at Google DeepMind (WaveNet, Imagen, Veo). I tweet about deep learning (research + software), music, generative models (personal account).

Joined December 2014

2K Following 67.9K Followers

Sander Dieleman@sedielem

2023.01.09 14:40

New blog post about diffusion language models: Diffusion models have completely taken over generative modelling of perceptual signals -- why is autoregression still the name of the game for language modelling? And can we do anything about that?