Lysandre(@LysandreJik):Transformers has supported loading GGUF files for a few years now, by unquantizing them. Thanks to @_marcsun, we're now using GGML kernels through the `kernels` library to run at the same performance as llama.cpp Huge kudos to the entire @ggml

Lysandre

@LysandreJik

Chief Open-Source Officer (COSO) at Hugging Face

Joined March 2019

647 Following 12.5K Followers

Lysandre@LysandreJik

2026.09.22 14:06

Transformers has supported loading GGUF files for a few years now, by unquantizing them. Thanks to @_marcsun, we're now using GGML kernels through the `kernels` library to run at the same performance as llama.cpp Huge kudos to the entire @ggml_org for making these kernels!