Congrats to @lightseekorg on the impressive TokenSpeed results! ๐ Great to see Qwen3.8-Flash-Next reaching 685 output tokens/s per user on Nvida GPUs. Excited to see the community unlock more of Qwenโs inference potential!
685 output tokens/s per user on @Alibaba_Qwen Qwen3.8-Flash-Next.
Running TokenSpeed on 4ร NVIDIA GB300 with NVFP4.
A look at the kernel and serving optimizations behind the results:
๐
โญ