Georgi Gerganov
@ggerganov
24th at the Electrica puzzle challenge | building | engineer @huggingface
参加 May 2015
300 フォロー中 73.8K ファン
llama.cpp can distribute inference on heterogeneous devices through the ggml RPC backend
It's an advanced setting but I think with time we'll make it more accessible to regular users.
