Sander Dieleman
@sedielem
Research Scientist at Google DeepMind (WaveNet, Imagen, Veo). I tweet about deep learning (research + software), music, generative models (personal account).
2K Following 67.9K Followers
@DavidSHolz @NicolasPerezNi1 Not entirely clear to me, I've mostly worked on the audiovisual modalities since 2023 so I wasn't around for this😬
The diffusion duality paper is nice in this regard, it potentially enables discrete models to access some of those theoretical advantages
Show more
New survey on diffusion language models: (via @NicolasPerezNi1). Covers pre/post-training, inference and multimodality, with very nice illustrations.
I can't help but feel a bit wistful about the apparent extinction of the continuous approach after 2023🥲
Show more
New blog post about diffusion language models:
Diffusion models have completely taken over generative modelling of perceptual signals -- why is autoregression still the name of the game for language modelling? And can we do anything about that?
Show more
