Sayak Paul
@RisingSayak
ML at Hugging Face 🤗
加入 May 2012
125 正在關注 24.8K 粉絲
Tensor parallel loading in 🤗 Diffusers got a massive upgrade 🔥
On Flux.2-Dev DiT, with a TP degree of 4 (A10G):
• 30.4s → 12.5s loading
• 64.1 → 6.8 GB peak CPU memory/rank
~2.4× faster loading. ~89% less CPU memory.
Check it out:
顯示更多
