登録して招待リンクを共有すると、動画再生報酬と紹介報酬を獲得できます。

Signal65
@Signal_65
We are here to ensure our partners become the signal of innovation in the noise of the technology markets.
参加 December 2023
106 フォロー中    1.3K ファン
An @AMD Instinct MI355X node does more agentic work per dollar as the serving stack behind it improves, and the same node now serves 1.44x the MiniMax-M3 throughput it did when Signal65 PINNACLE first published it, in our testing. ➡️ AITER unified attention and piecewise graph capture on the same vLLM 0.23.1 build added 11% peak throughput and took the MI355X node from 52 to 56 agents sustained at the service floor ➡️ At 8 agents, per-agent decode went from 18.3 to 43.4 tok/s, 2.4x, on the same build ➡️ vLLM 0.30.1 with the @AMD MiniMax-M3 configuration added another 30%, 563 to 731 tok/s ➡️ 31% lower cost per output token on hardware a buyer already owns On the version-matched build the MI355X now sustains more agents at the PINNACLE floor than the NVIDIA B300. AMD engineering has been a strong partner in this work, and more MI355X results on the current vLLM cycle are coming. @AnushElangovan @roaner @AIatAMD
もっと見る