Georgi Gerganov
@ggerganov
24th at the Electrica puzzle challenge | building | engineer @huggingface
가입 May 2015
300 팔로잉 중 73.8K 팬
llama.cpp can distribute inference on heterogeneous devices through the ggml RPC backend
It's an advanced setting but I think with time we'll make it more accessible to regular users.
