Register and share your invite link to earn from video plays and referrals.

Inferact
@inferact
Building the future of inference through @vllm_project
Joined December 2025
5 Following    8.3K Followers
Today, we are announcing an engineering collaboration with @AMD to strengthen production agentic inference on AMD Instinct GPUs in @vllm_project. AMD brings the Instinct platform, ROCm engineering, and the AITER kernel library, while Inferact and the vLLM community bring model integration, serving features, and day-0 enablement. Together, we are focused on agentic workloads with long-running sessions, long prefixes, and tool calling, and each configuration will ship as a public per-model serving recipe. This work is already running in production. It shipped with this summer’s major open-model releases, and Inferact uses it on AMD Instinct clusters for our Inferact Platform customers. Everything this collaboration produces lands in open source. Read the full announcement:
Show more