đ¨ China's Big Bang Chips Launch - Ox-Alpha's 100T Token Capacity Mystery Solved
Ox-Alpha (GLM 3.5 Flash) served 42 trillion tokens processed in 6 days. For free. On Chinese chips. Here's how they pulled it off:
â Built a custom SGLang inference engine with disaggregated Encode-Prefill-Decode architecture
â Used a GLM-5.3 infrastructure agent to write its own GPU kernels and debug bottlenecks â the model literally optimized its own serving stack
â Achieved 3Ã end-to-end performance gains and Nvidia-level cost parity on domestic silicon
â Backed by Zai's 1GW data center running entirely on Chinese chips â 10,000+ chip clusters, zero Nvidia silicon (i was wrong)
Export controls were supposed to slow China down. Instead they forced Zai to build a fully sovereign AI stack â and it works!! China just proved to the world that they are not compute constrained