Adewuyi Israel
@Israel_Adewuyi_
🌌🇳🇬
가입 March 2018
724 팔로잉 중 87 팬
Been working on nanoTitan for the past couple of weeks and I am excited to share the progress!
nanoTitan is a minimal distributed training codebase for MoE. Currently, DP, PP, EP as well as any of their compositions (up to 3D) have been implemented.
Links below
더 보기
