Congrats to @lightseekorg on the impressive TokenSpeed results! 🚀 Great to see Qwen3.8-Flash-Next reaching 685 output tokens/s per user on Nvida GPUs. Excited to see the community unlock more of Qwen’s inference potential!
685 output tokens/s per user on @Alibaba_Qwen Qwen3.8-Flash-Next.
Running TokenSpeed on 4× NVIDIA GB300 with NVFP4.
A look at the kernel and serving optimizations behind the results:
👉
⭐