註冊並分享邀請連結,可獲得影片播放與邀請獎勵。

netrunner
@plotarmordev
Cofounder & engineer. Running local AI, building things with it, and sharing what I learn.
加入 April 2022
806 正在關注    8.4K 粉絲
Transport tuning should be part of setting up your cluster (Sparks or anything else). It means choosing how data moves between GPUs and machines, including the communication backend and network path to use. Save the transport choice with that topology so it doesn't become something to revisit every time you run inference.
顯示更多