Xiuyu Li(@sheriyuo):iLLaDA is an 8B masked diffusion language model trained from scratch with fully bidirectional attention, keeping the masked-diffusion objective all the way through pretraining and SFT rather than bolting diffusion onto an autoregressive base. Improved Large Language Diffusion Models Paper:

Xiuyu Li

@sheriyuo

Researcher @StepFun_ai | Working on long-horizon tasks | Prev @RUC1937 | Opinions are my own

가입 February 2026

1.7K 팔로잉 중 12.4K 팬

Xiuyu Li@sheriyuo

2026.06.25 02:46

iLLaDA is an 8B masked diffusion language model trained from scratch with fully bidirectional attention, keeping the masked-diffusion objective all the way through pretraining and SFT rather than bolting diffusion onto an autoregressive base. Improved Large Language Diffusion Models Paper: