注册并分享邀请链接,可获得视频播放与邀请奖励。

PyTorch
@PyTorch
Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation#
加入 September 2016
108 正在关注    522K 粉丝
Running large Mixture-of-Experts models across pods creates two major challenges: expert dispatch and combine traffic, and moving the KV cache between prefill and decode. At #PyTorchCon# North America 2026, Ravi Gupta, Rishi Madduri, and Shiksha Patel (@AMD) will present “MoRI + vLLM: Wide Expert Parallelism and RDMA KV-Cache Transfer for Disaggregated MoE Serving on AMD.” The poster will show how bringing the MoRI communication stack into @vllm_project enables Wide Expert Parallelism across pods using RDMA and moves the KV cache for disaggregated prefill and decode on AMD Instinct GPUs. They will also cover correctness and stability issues encountered when spanning pods and share vLLM benchmark results for long, high-concurrency workloads. Register for PyTorch Conference North America 2026:
显示更多
0
11
56
6
转发到社区