Sayak Paul
@RisingSayak
ML at Hugging Face 🤗
参加 May 2012
125 フォロー中 24.8K ファン
Tensor parallel loading in 🤗 Diffusers got a massive upgrade 🔥
On Flux.2-Dev DiT, with a TP degree of 4 (A10G):
• 30.4s → 12.5s loading
• 64.1 → 6.8 GB peak CPU memory/rank
~2.4× faster loading. ~89% less CPU memory.
Check it out:
もっと見る
