LightSeek Foundation(@lightseekorg):We’re proud to be the Day 0 open-source inference engine partner for @Alibaba_Qwen 3.8. To serve this 2.4T-parameter model across multi-node @NVIDIAAI Blackwell inference, we optimized DP/EP scaling across nodes, delivering 30%+ faster performance than TP16, plus DSpark speculative decoding with single CUDA graph optimization👇

LightSeek Foundation

@lightseekorg

LightSeek is the creator of TokenSpeed, TorchSpec, and SMG — building next-generation AI infra systems

参加 October 2025

0 フォロー中 2.8K ファン

LightSeek Foundation@lightseekorg

2026.08.12 19:00

We’re proud to be the Day 0 open-source inference engine partner for @Alibaba_Qwen 3.8. To serve this 2.4T-parameter model across multi-node @NVIDIAAI Blackwell inference, we optimized DP/EP scaling across nodes, delivering 30%+ faster performance than TP16, plus DSpark speculative decoding with single CUDA graph optimization👇