Adewuyi Israel(@Israel_Adewuyi_):Been working on nanoTitan for the past couple of weeks and I am excited to share the progress! nanoTitan is a minimal distributed training codebase for MoE. Currently, DP, PP, EP as well as any of their compositions (up to 3D) have been implemented. Links below

2026.09.06 08:28

Been working on nanoTitan for the past couple of weeks and I am excited to share the progress! nanoTitan is a minimal distributed training codebase for MoE. Currently, DP, PP, EP as well as any of their compositions (up to 3D) have been implemented. Links below

显示更多