llama.cpp v0.9.0 is out 💃🕺
> Native FP8 (OCP E4M3)
> Faster multi-seq serving: flash_attn_ext_rows
> Multi-node tensor parallel via NCCL (ggml 0.29.0)
> New models: Clover, Limite, Metis-1.6, Mistral Large 4
> Speech: Chatterbox TTS, Nemotron 3.5 Transcribe
> Faster Gemma 4 E2B/E4B prefill
> much more...
もっと見る
