Ali Hatamizadeh
@ahatamiz1
LLM Tech Lead & Staff Research Scientist @NVIDIA
Co-creator of Gated DeltaNet & Gated DeltaNet-2
加入 June 2015
180 正在關注 4.1K 粉絲
GDN for diffusion LLMs 🚀💚
dQwen3.5: Hybrid-Attention Diffusion Language Models
Adapting hybrid attention-RNN language models into diffusion models achieves a given training loss in about half the tokens of a full-attention control, while supporting strong parallel decoding.
顯示更多
