가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

Signal65
@Signal_65
We are here to ensure our partners become the signal of innovation in the noise of the technology markets.
가입 December 2023
106 팔로잉 중    1.3K 팬
An @AMD Instinct MI355X node does more agentic work per dollar as the serving stack behind it improves, and the same node now serves 1.44x the MiniMax-M3 throughput it did when Signal65 PINNACLE first published it, in our testing. ➡️ AITER unified attention and piecewise graph capture on the same vLLM 0.23.1 build added 11% peak throughput and took the MI355X node from 52 to 56 agents sustained at the service floor ➡️ At 8 agents, per-agent decode went from 18.3 to 43.4 tok/s, 2.4x, on the same build ➡️ vLLM 0.30.1 with the @AMD MiniMax-M3 configuration added another 30%, 563 to 731 tok/s ➡️ 31% lower cost per output token on hardware a buyer already owns On the version-matched build the MI355X now sustains more agents at the PINNACLE floor than the NVIDIA B300. AMD engineering has been a strong partner in this work, and more MI355X results on the current vLLM cycle are coming. @AnushElangovan @roaner @AIatAMD
더 보기