Space Bunny is here! đ° MiniMax M3.1 Flash hits >1K tok/s, bs1 decode with SGLang, production-ready from Day 0. This integration is a joint effort by
@MiniMax_AI,
@NVIDIAAI,
@AMD, and
@radixark, and you can also run RL with Miles!
-Broad hardware support: NVIDIA Blackwell and Hopper (GB300/B300/B200/H200), plus AMD Instinct MI350X and MI355X.
-Agentic serving at scale: ~100K total tok/s per GPU on the AgentX coding-agent trace with 96 concurrent sessions.
-Speculative decoding: Supports MiniMax's DSpark draft and a DFlash2 draft trained by
@radixark; supports HiCache and multimodal input.
-Ultra-low-latency inference: MegaKernels deliver 2.15Ã faster single-request decode.