Transformers has supported loading GGUF files for a few years now, by unquantizing them.
Thanks to @_marcsun, we're now using GGML kernels through the `kernels` library to run at the same performance as llama.cpp
Huge kudos to the entire @ggml_org for making these kernels!
