๊ฐ€์ž… ํ›„ ์ดˆ๋Œ€ ๋งํฌ๋ฅผ ๊ณต์œ ํ•˜๋ฉด ๋™์˜์ƒ ์žฌ์ƒ ๋ฐ ์ดˆ๋Œ€ ๋ณด์ƒ์„ ๋ฐ›์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.

Nouamane Tazi
@Nouamanetazi
Training LLMs @huggingface ๐Ÿค—. Author of
๊ฐ€์ž… May 2012
1.9K ํŒ”๋กœ์ž‰ ์ค‘    3.8K ํŒฌ
๐Ÿ“– The Ultimate MoE Training Handbook ๐Ÿ“– We spent 1/2M GPUh to optimize MoE training and wrote the most comprehensive blog about it. With 30k words and 50+ interactive figures it covers everything from profiling to large cluster training.
๋” ๋ณด๊ธฐ