Zijie Yan
@zijie_y
working on training infra at @periodiclabs
prev led Megatron MoE at @nvidia
152 Following 782 Followers
Neon’s scientific traces are long and vary widely in length. Training on them shouldn’t mean GPUs chewing through padding or waiting for each other.
Here’s how we pack sequences, balance the work, and distribute long contexts across GPUs at @periodiclabs 👇
Show more
