注册并分享邀请链接,可获得视频播放与邀请奖励。

Georgi Gerganov
@ggerganov
24th at the Electrica puzzle challenge | building | engineer @huggingface
加入 May 2015
300 正在关注    75.1K 粉丝
llama.cpp can distribute inference on heterogeneous devices through the ggml RPC backend It's an advanced setting but I think with time we'll make it more accessible to regular users.
0
25
478
40
转发到社区