Xiuyu Li(@sheriyuo):iLLaDA is an 8B masked diffusion language model trained from scratch with fully bidirectional attention, keeping the masked-diffusion objective all the way through pretraining and SFT rather than bolting diffusion onto an autoregressive base. Improved Large Language Diffusion Models Paper:

Xiuyu Li

@sheriyuo

Researcher @StepFun_ai | Working on long-horizon tasks | Prev @RUC1937 | Opinions are my own

加入 February 2026

1.7K 正在关注 12.4K 粉丝

Xiuyu Li@sheriyuo

2026.06.25 02:46

iLLaDA is an 8B masked diffusion language model trained from scratch with fully bidirectional attention, keeping the masked-diffusion objective all the way through pretraining and SFT rather than bolting diffusion onto an autoregressive base. Improved Large Language Diffusion Models Paper:

显示更多