Georgi Gerganov
@ggerganov
24th at the Electrica puzzle challenge | building | engineer @huggingface
参加 May 2015
294 フォロー中 71.8K ファン
Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility and performance. More info below
Millions of GGUF downloads later, those same llama.cpp checkpoints can now run in 🤗 transformers.
Same models, more ways to use them, and fast local inference on Mac powered by ggml kernels!
Blog:
ggml kernels:
もっと見る
