注册并分享邀请链接,可获得视频播放与邀请奖励。

netrunner
@plotarmordev
Cofounder & engineer. Running local AI, building things with it, and sharing what I learn.
加入 April 2022
806 正在关注    8.4K 粉丝
Transport tuning should be part of setting up your cluster (Sparks or anything else). It means choosing how data moves between GPUs and machines, including the communication backend and network path to use. Save the transport choice with that topology so it doesn't become something to revisit every time you run inference.
显示更多