Think
@DeepSpeedAI is only good for ZeRO and its usability, not training throughput?
At #
PyTorchCon# North America 2026, Masahiro Tanaka will cover tensor, sequence, and expert parallelism in DeepSpeed and walk through benchmarks.
His session, “DeepSpeed Is Not Just ZeRO: Tensor, Sequence, and Expert Parallelism with ZeRO-Level Usability,” will cover AutoTP, AutoSP, and AutoEP, how these capabilities can be combined with ZeRO, and where each parallelism strategy fits.
Register for PyTorch Conference North America 2026: