Today, we are announcing an engineering collaboration with @AMD to strengthen production agentic inference on AMD Instinct GPUs in @vllm_project. AMD brings the Instinct platform, ROCm engineering, and the AITER kernel library, while Inferact and the vLLM community bring model integration, serving features, and day-0 enablement. Together, we are focused on agentic workloads with long-running sessions, long prefixes, and tool calling, and each configuration will ship as a public per-model serving recipe. This work is already running in production. It shipped with this summer’s major open-model releases, and Inferact uses it on AMD Instinct clusters for our Inferact Platform customers. Everything this collaboration produces lands in open source. Read the full announcement: