๐จ China's Big Bang Chips Launch - Ox-Alpha's 100T Token Capacity Mystery Solved
Ox-Alpha (GLM 3.5 Flash) served 42 trillion tokens processed in 6 days. For free. On Chinese chips. Here's how they pulled it off:
โ Built a custom SGLang inference engine with disaggregated Encode-Prefill-Decode architecture
โ Used a GLM-5.3 infrastructure agent to write its own GPU kernels and debug bottlenecks โ the model literally optimized its own serving stack
โ Achieved 3ร end-to-end performance gains and Nvidia-level cost parity on domestic silicon
โ Backed by Zai's 1GW data center running entirely on Chinese chips โ 10,000+ chip clusters, zero Nvidia silicon (i was wrong)
Export controls were supposed to slow China down. Instead they forced Zai to build a fully sovereign AI stack โ and it works!! China just proved to the world that they are not compute constrained