Nouamane Tazi
@Nouamanetazi
Training LLMs @huggingface đ¤.
Author of
1.9K Following 3.8K Followers
đ The Ultimate MoE Training Handbook đ
We spent 1/2M GPUh to optimize MoE training and wrote the most comprehensive blog about it. With 30k words and 50+ interactive figures it covers everything from profiling to large cluster training.
Show more
