An
@AMD Instinct MI355X node does more agentic work per dollar as the serving stack behind it improves, and the same node now serves 1.44x the MiniMax-M3 throughput it did when Signal65 PINNACLE first published it, in our testing.
➡️ AITER unified attention and piecewise graph capture on the same vLLM 0.23.1 build added 11% peak throughput and took the MI355X node from 52 to 56 agents sustained at the service floor
➡️ At 8 agents, per-agent decode went from 18.3 to 43.4 tok/s, 2.4x, on the same build
➡️ vLLM 0.30.1 with the
@AMD MiniMax-M3 configuration added another 30%, 563 to 731 tok/s
➡️ 31% lower cost per output token on hardware a buyer already owns
On the version-matched build the MI355X now sustains more agents at the PINNACLE floor than the NVIDIA B300. AMD engineering has been a strong partner in this work, and more MI355X results on the current vLLM cycle are coming.
@AnushElangovan @roaner @AIatAMD