Georgi Gerganov
@ggerganov
24th at the Electrica puzzle challenge | building | engineer @huggingface
加入 May 2015
294 正在关注 71.8K 粉丝
Run GGUF models directly with transformers. This work brings ggml's Metal kernels to the transformers ecosystem, increasing compatibility and performance. More info below
Millions of GGUF downloads later, those same llama.cpp checkpoints can now run in 🤗 transformers.
Same models, more ways to use them, and fast local inference on Mac powered by ggml kernels!
Blog:
ggml kernels:
显示更多
