Clef Flash 9B Q8_0, fully on an RTX 5060 Ti:
llama.cpp was ~30% faster on prompt eval: about 3,000 vs 2,100 prompt tokens/s. Same gap on text and a single image.
```
llama-server -b 8192 -hf ggml-org/Clef-Flash-GGUF:Q8_0
ollama run clef-flash:9b-q8_0
```
もっと見る
